Spring SFTP：无法重命名.writing文件

huangapple
go评论103阅读模式
英文:

Spring SFTP : Unable to rename .writing file

问题

我正在使用Spring SFTP集成来传输文件，但很多次我都遇到了这个错误。看起来有两个线程尝试传输同一个文件并且彼此冲突。

>2020-08-03 08:31:55,766 INF [task-scheduler-8 ] o.s.i.ftp.session.FtpSession - 文件已成功从以下位置传输：./abc.ext.200803
<br>
>2020-08-03 08:31:55,849 INF [task-scheduler-7 ] o.s.i.ftp.session.FtpSession - 文件已成功从以下位置传输：./abc.ext.200803<br>
>2020-08-03 08:31:55,850 INF [task-scheduler-7 ] .s.i.f.i.FtpInboundFileSynchronizer - 在删除后，无法将'/local/download/abc.ext.200803.writing' 重命名为本地文件'/local/download/abc.ext.200803'。本地文件可能在其他进程中忙碌。<br>

是否有办法让这两个线程不相互干扰？

我正在使用以下代码 -

  1. @Bean
  2. public SftpInboundFileSynchronizer ftpInboundFileSynchronizer() {
  3. 	isFTPSessionOK();
  4. 	SftpInboundFileSynchronizer fileSynchronizer = new SftpInboundFileSynchronizer(sftpSessionFactory());
  6. 	fileSynchronizer.setPreserveTimestamp(true);
  7. 	fileSynchronizer.setRemoteDirectory(remoteDirectory);
  8. 	fileSynchronizer.setDeleteRemoteFiles(false);
  10. 	fileSynchronizer.setFilter(new SFTPLastModifiedFileFilter(remoteFileFilter));
  11. 	return fileSynchronizer;
  12. }
  14. private boolean isFTPSessionOK() {
  15. 	try {
  16. 		SessionFactory&lt;LsEntry&gt; ftpSessionFactory = sftpSessionFactory();
  17. 		boolean open = ftpSessionFactory.getSession().isOpen();
  18. 		LOG.info(&quot;FTPSession is good ? &quot; + open);
  19. 		return open;
  20. 	} catch (Exception e) {
  21. 		LOG.error(&quot;FTPSession is not good because of error : &quot; + e);
  22. 	}
  23. 	return false;
  24. }
  26. @Bean
  27. public SessionFactory&lt;LsEntry&gt; sftpSessionFactory() {
  28. 	DefaultSftpSessionFactory sf = new DefaultSftpSessionFactory();
  29. 	sf.setHost(server);
  30. 	sf.setPort(port);
  31. 	sf.setUser(username);
  32. 	sf.setPassword(password);
  33. 	sf.setAllowUnknownKeys(true);
  34. 	return new CachingSessionFactory&lt;LsEntry&gt;(sf);
  35. }
  37. @Bean
  38. @InboundChannelAdapter(channel = &quot;sftpChannel&quot;, poller = @Poller(fixedDelay = &quot;${${project.name}.ftp.poller.delay:600000}&quot;, maxMessagesPerPoll = &quot;1&quot;))
  39. public MessageSource&lt;File&gt; ftpMessageSource() {
  40. 	SftpInboundFileSynchronizingMessageSource source = new SftpInboundFileSynchronizingMessageSource(ftpInboundFileSynchronizer());
  41. 	source.setLocalDirectory(new File(localFtpDirectory));
  42. 	source.setAutoCreateLocalDirectory(true);		
  43. 	return source;
  44. }
  46. @Bean
  47. @ServiceActivator(inputChannel = &quot;sftpChannel&quot;)
  48. public MessageHandler ftpHandler() {
  49. 	return new MessageHandler() {
  51. 		@Override
  52. 		public void handleMessage(Message&lt;?&gt; message) throws MessagingException {
  53. 			LOG.info(&quot;File &#39;{}&#39; is ready for reading after SFTP&quot;, message.getPayload());
  54. 		}
  55. 	};
  56. }
英文:

I am using Spring SFTP integration to transfer the file and many time I got this error. It seems two threads are trying to transfer same file and conflict with each other

>2020-08-03 08:31:55,766 INF [task-scheduler-8 ] o.s.i.ftp.session.FtpSession - File has been successfully transferred from: ./abc.ext.200803
<br>
>2020-08-03 08:31:55,849 INF [task-scheduler-7 ] o.s.i.ftp.session.FtpSession - File has been successfully transferred from: ./abc.ext.200803<br>
>2020-08-03 08:31:55,850 INF [task-scheduler-7 ] .s.i.f.i.FtpInboundFileSynchronizer - Cannot rename '/local/download/abc.ext.200803.writing' to local file '/local/download/abc.ext.200803' after deleting. The local file may be busy in some other process.<br>

Is there a way so both threads should not interfere with each other?

I am using following code -

  1. @Bean
  2. public SftpInboundFileSynchronizer ftpInboundFileSynchronizer() {
  3. 	isFTPSessionOK();
  4. 	SftpInboundFileSynchronizer fileSynchronizer = new SftpInboundFileSynchronizer(sftpSessionFactory());
  6. 	fileSynchronizer.setPreserveTimestamp(true);
  7. 	fileSynchronizer.setRemoteDirectory(remoteDirectory);
  8. 	fileSynchronizer.setDeleteRemoteFiles(false);
  10. 	fileSynchronizer.setFilter(new SFTPLastModifiedFileFilter(remoteFileFilter));
  11. 	return fileSynchronizer;
  12. }
  14. private boolean isFTPSessionOK() {
  15. 	try {
  16. 		SessionFactory&lt;LsEntry&gt; ftpSessionFactory = sftpSessionFactory();
  17. 		boolean open = ftpSessionFactory.getSession().isOpen();
  18. 		LOG.info(&quot;FTPSession is good ? &quot; + open);
  19. 		return open;
  20. 	} catch (Exception e) {
  21. 		LOG.error(&quot;FTPSession is not good because of error : &quot; + e);
  22. 	}
  23. 	return false;
  24. }
  26. @Bean
  27. public SessionFactory&lt;LsEntry&gt; sftpSessionFactory() {
  28. 	DefaultSftpSessionFactory sf = new DefaultSftpSessionFactory();
  29. 	sf.setHost(server);
  30. 	sf.setPort(port);
  31. 	sf.setUser(username);
  32. 	sf.setPassword(password);
  33. 	sf.setAllowUnknownKeys(true);
  34. 	return new CachingSessionFactory&lt;LsEntry&gt;(sf);
  35. }
  37. @Bean
  38. @InboundChannelAdapter(channel = &quot;sftpChannel&quot;, poller = @Poller(fixedDelay = &quot;${${project.name}.ftp.poller.delay:600000}&quot;, maxMessagesPerPoll = &quot;1&quot;))
  39. public MessageSource&lt;File&gt; ftpMessageSource() {
  40. 	SftpInboundFileSynchronizingMessageSource source = new SftpInboundFileSynchronizingMessageSource(ftpInboundFileSynchronizer());
  41. 	source.setLocalDirectory(new File(localFtpDirectory));
  42. 	source.setAutoCreateLocalDirectory(true);		
  43. 	return source;
  44. }
  46. @Bean
  47. @ServiceActivator(inputChannel = &quot;sftpChannel&quot;)
  48. public MessageHandler ftpHandler() {
  49. 	return new MessageHandler() {
  51. 		@Override
  52. 		public void handleMessage(Message&lt;?&gt; message) throws MessagingException {
  53. 			LOG.info(&quot;File &#39;{}&#39; is ready for reading after SFTP&quot;, message.getPayload());
  54. 		}
  55. 	};
  56. }

答案1

得分: 1

以下是要翻译的内容：

你只有这个用于过滤的内容：

fileSynchronizer.setFilter(new SFTPLastModifiedFileFilter(remoteFileFilter));

但是怎么样才能防止后续轮询中的重复项呢？

请查看AcceptOnceFileListFilter。并且与SFTPLastModifiedFileFilter一起使用ChainFileListFilter。

请查阅文档以获取更多信息：

https://docs.spring.io/spring-integration/docs/current/reference/html/sftp.html#sftp-inbound

https://docs.spring.io/spring-integration/docs/current/reference/html/file.html#file-reading

英文:

You have only this for filtering:

  1. fileSynchronizer.setFilter(new SFTPLastModifiedFileFilter(remoteFileFilter));

but what about a filter which is going to prevent duplicates on subsequent poll?

See AcceptOnceFileListFilter. And together with that SFTPLastModifiedFileFilter you should use a ChainFileListFilter.

See docs for more info:

https://docs.spring.io/spring-integration/docs/current/reference/html/sftp.html#sftp-inbound

https://docs.spring.io/spring-integration/docs/current/reference/html/file.html#file-reading

huangapple
  • 本文由 发表于 2020年8月3日 20:30:44
  • 转载请务必保留本文链接：https://go.coder-hub.com/63229482.html
  • java
  • spring
  • spring-batch
  • spring-integration
  • spring-integration-sftp
匿名

发表评论

匿名网友

:?: :razz: :sad: :evil: :!: :smile: :oops: :grin: :eek: :shock: :???: :cool: :lol: :mad: :twisted: :roll: :wink: :idea: :arrow: :neutral: :cry: :mrgreen:

确定