...

• Start Fiorano Enterprise Server (FES) and Fiorano Peer Server (FPS)
• Start SFTP server. If SFTP server is not installed, refer the Installing SFTP Server section below.
• Login to eStudio application
• Understand the basic menus and perspectives (panels) in eStudio application

...

1. Install vsftpd server by executing the following command in the Command prompt:
   yum install vsftpd
2. Generate keys pairs (both RSA and DSA) and store in ~/.ssh/ directory. For key generation, we can use the following commands for RSA type and DSA type key generations respectively:
   ssh-keygen -t rsa
ssh-keygen -t dsa
3. While executing the above commands, file name and password for the file has to be provided. If the file name provided is id_rsa, then two files will be generated named id_rsa.pub and id_rsa which are public key and private key respectively.
4. Install the public keys in the server. Private key has to be with the client which is used to connect to the server. The SFTP server will authenticate the client's private key using its public key. This type of client-authentication is called Private Key Authentication. The installation of the public key in the server can be done by executing the following command:
   ssh-copy-id -i ~/.ssh/id_rsa.pub root@localhost
   where "~/.ssh/id_rsa.pub" is the rsa public key file path and "root@localhost" is the server (here we are using the same machine).
5. Change the following in sshd_config file located at etc/ssh/ folder:
   1. Set RSAAuthentication or DSAAuthentication to 'yes' based on the key file type used.
   2. Add the line "IdentityFile ~/.ssh/id_rsa" in the ssh_config file located at /etc/ssh (if already Identity File is set to some other file, modify it).
6. Restart the servers using the following commands:
   /etc/rc.d/init.d/sshd restart
/etc/rc.d/init.d/vsftpd restart

...

FTPGet component helps to download the file from the FTP Server. To configure FTPGet component, perform the following actions:

1. Add a new Event Process (EP) with the name 'SFTP_Monitoring_Eg'.
2. Drag the FTPGet component from the Bridges category in the Micro Service Palette to the Fiorano Orchestrator.
   
   
   Figure 1: Adding FTPGet component in SFTP_Monitoring_eg EP
    
3. Double-click the FTPGet component to open its Configuration Property Sheet (CPS).
   
   
   Figure 2: FTPGet CPS

...

1. In theManaged Connection Factory window, click Connection Properties tab to expand the options and click the Connection Configuration Ellipsis button.
   
   
   Figure 3: Navigating to do Connection Configuration
    
2. In FtpConnectionConfig dialog box, select 'SFTP' from the Protocol drop-down under Component Configuration section and provide the following values menu to load the SFTP server configuration settings:
   1. Remote host: The IP address of the machine where the SFTP server is running. In this example, it is 'localhost' as may be used if the server is installed in the same machine.
   2. Port: 22, the port number on which the FTP server is running.
   3. Login: Username to be used to login to the SFTP server. In the example, it is root, the user under which the server had been installed in the machine.
   4. Client Authentication Type: Select 'Private Key' from the drop-down to login to the SFTP server using the client's private key. Three fields needed for private key authentication appear: Private Key Type, Private Key file, and Private Key Password.
   5. Private Key: Provide the path of the private key (id_rsa) generated above in the Private key field. Select the Private key type as RSA/DSA depending on the generated key. Enter the Private key password also to provide access to the key by the server.
      Image Removed
      Image Added
      Figure 4: SFTP protocol configuration
       
3. Click OK to save the server configuration.
4. After saving the connection configuration details, click the Test button in Managed Connection Factory page. Test Connection Configuration pop-up shows the connection status.
   
   
   Figure 5: Testing SFTP Protocol connection

...

1. In the Managed Connection Factory page, click Next to move to the Interaction Configurations Page.
   
   
   Figure 6: Interaction Configurations panel in FTPGet CPS
    
2. Select the Monitor Directory checkbox to enable Monitoring on the SFTP server. Three options appear as below:
   1. Monitor Directory Configuration
   2. Monitor Time Configuration
   3. Use File not FoundException in Monitoring
   
   Figure 7: Selecting Monitor Directory option
    
3. Click the Monitor Directory Configuration Ellipsis button to open the FtpMonitoringConfiguration window.
   
   
   Figure 8: Navigating to Monitor Directory Configuration
    
4. In the FtpMonitoringConfiguration window, provide the following details:
   
   1. Enter the folder path on the server where the files need to be monitored. Enter paths for Working directory, Processed directory and Error directory also and all of these paths should be different from each other.
   2. Select Move to working directory checkbox, if the files which are processed need to be moved to the Processed directory after the transfer is complete. Also, files will move to error directory in case of any unexpected error during the transfer. If the checkbox is cleared, then files will remain in the source folder even after the processing is complete.
   3. Provide value for File name patterns to filter specific file types that needs need to be monitored in the source folder. In this example, it is "*.csv", which picks all the .csv files in the source folder for processing.
       
   
   Figure 9: Configuring Directory details
    
5. Click OK to save the Monitoring Directory configuration.

...

...

1. Drag a Display component also to easel the orchestrator editor from Micro Service Palette under Util category.
2. Connect the output port of FTPGet component to input port of Display component.
   Image Removed
   Image Added
   Figure 16: Connecting FTPGet component to Display

...

1. Click Check Resource and Connectivity icon (or press ALT+SHIFT+C) to check resource and connectivity.
2. Click Run Event Process icon (ALT+SHIFT+R) to run the event process. Display window gets opened.
3. Add a file 'Newfile.csv' with last modified time as '12 March 2014 08:09:25 PM' in the source folder after the second poll.
4. Display window gets the message when the file transfer happens.
   Image Removed
   Image Added
   Figure 17: Message appearing in Display after the File Transfer

...

1. Source folder configured in FTP component contains the following files with the corresponding time of modification:
   1. CheckHead_01232014.csv: Tue 11 Mar 2014 11:00:20 PM IST
   2. CheckItems_01232014.csv: Wed 12 Mar 2014 07:52:55 PM IST
   3. Data.txt: Wed 12 Mar 2014 07:39:16 PM IST
   4. Hello.txt: Thu 23 Jan 2014 05:48:34 PM IST
   5. Number.txt: Wed 12 Mar 2014 07:38:57 PM IST 
   
   Figure 18: Contents in the Source Folder
    
2. In the first poll, after launching the event process (12 March 2014 08:02:15 PM in this example), while monitoring the folder, only the files 'CheckHead_01232014.csv' and 'CheckItems_01232014.csv' will be picked for processing, as they match both the pattern name condition (.csv file type) as well as the HIGHEST MODIFICATION TIME filter condition for the first poll. Both the files have last modification time greater than the Base time provided in the Monitor Time Configuration.
3. After the first poll gets completed and all the matching file transfers are finished, the component calculates the Highest Modification Time among all the processed files and save it for next poll. In this case, it will be '12 March 2014 07:52:55 PM'.
4. In the Second poll (at 12 March 2014 08:07:15 PM as per Repeat Interval - 5 minutes), none of the files will be processed, as all the files have last modification time less than or equal to the Highest Modification Time calculated in the previous poll.
5. After Second poll, add a file 'new.csv' with last modified time as '12 March 2014 08:09:25 PM' in the source folder after the second poll. (please do this manually)
6. In the Third poll, the Highest Modification Time value will still be '12 March 2014 07:52:55 PM' as it did not process any new files in the previous poll. Now the file named Newfile.csv will be processed in the third poll (at 08:12:15 PM) as its last modification time is greater than the Highest Modification Time value and matches the file pattern name. The FTPGet Output response appears in Display window (as provided in "Running the Example" section) after the transfer gets completed.
7. After the transfer of Newfile.csv file gets completed, the Highest Modification Time value will be set to the last modified time of the Newfile.csv file as it is the only file processed during the third poll and the component will continue its polling as per the Scheduler Configuration.

Anchor
_Toc382505829 _Toc382505829

Reference

• Download SFTP_Monitoring_Eg event process and import it to the Event Process Repository in the Server Explorer in eStudio to understand the configuration used in this example and to execute the working sample.
  • Download the Private Key File used in this example, save it in a particular location and provide it in the (See Figure 4); the password for this Private Key is <TBD>
• Please note that the component options used in this example are minimum, which helps you to get an overview of the application. To explore the other options present in the FTPGet and Display components, refer: FTPGet and Display sections.