How to plan the data streamingInstructionsBefore streaming the actual data, it is important to note that it is highly recommended to stream complete business process: For example, your monitored app runs on an apache web server, it uses tomcat server as middleware, and a SQL server to store user data and configurations. You are also using Haproxy load balancer to support high availability. It will be best to stream to Sophie all of the above to get complete coverage for the app. Just as in the example above, you’re probably going to stream to Sophie 3rd party products (in our example: apache, SQL, etc.) and your proprietary products. For 3rd party products: We recommend using Sophie's pre-defined templates which can be found under Settings >> Add and Manage Data >> Source Types. For you proprietary logs: We recommend creating your own template either prior to streaming your data by importing around 1000 sample logs, or after streaming data for a few short minutes (please pause streaming then set up the Source Type) For additional information: How to make sure my source types exist For additional information: Create a new source type OR Edit an auto-created source type Please note that it is crucial that the data streamed to Sophie will include a timestamp. If it does not, please contact Loom support For additional information on Source Types, Services, Applications and their relations use this link For SaaS solution we recommend: Filebeat is one of the easiest and safest ways to stream data to Sophie. Some of its advantages include the ability to handle multiline events prior to sending them to Sophie. In case you’re streaming data from Linux servers, and you have already installed Rsyslog agent (version 6.0 and above), use the our automatic collector for LinuxFor additional information: How to stream automatically Linux serversIn case you have a pre-existing Logstash (version 2 and above), it is advisable to ship the data from Logstash to SophieIn case you’re streaming data from Windows servers, it is recommended to install Winlogbeat and use it to stream MS-Eventlog data. For on-premise solution we recommend: Filebeat is one of the easiest and safest ways to stream data to Sophie. Some of its advantages include the ability to handle multiline events prior to sending them to Sophie. Streaming data via TCP or UDP is also an easy and straight-forward way to get the data into Sophie.In case you’re streaming data from Linux servers, and you have already installed Rsyslog agent (version 6.0 and above), use the our automatic collector for LinuxFor additional information: How to stream automatically Linux serversIn case you have a pre-existing Logstash (version 2 and above), it is advisable to ship the data from Logstash to SophieIn case you’re streaming data from Windows servers, it is recommended to install Winlogbeat and use it to stream MS-Eventlog data.In case you are a Splunk user, it is possible to configure Sophie to receive data from Splunk, although it is highly recommended to stream the data to Sophie directly and not through Splunk Choosing the data input After making sure you know which is the best method to ship your data to Sophie, go to Settings/Add & Manage Data/Data Inputs, and click on "Plug a new data input".