Executive summary
This firm runs hundreds of services which optimize online advertising. The company utilizes large amounts of data which is located both on-premise and on AWS.
They wanted to:
- Support a Kubernetes-based deployment with a dynamic environment (hundreds of services/ thousands of sources).
- Create an efficient and focused way for developers/operations teams to quickly troubleshoot problems.
- Achieve Sarbanes-Oxley Act (SOX) regulations on some of their managed data.
- Reduce and optimize deployment/maintenance costs.
By using XpoLog the company created a single location that manages all the information from all the sources. The information is shipped to the XpoLog cluster and tagged to the relevant service/team.
XpoLog is deployed and managed on AWS spot instances, reducing approximately 90% of the required hardware costs!
The Challenge and Requirements
The environment consists of multiple applications, servers and databases, located on both internal data centers and AWS.
- It was difficult to gather all the information due to the dynamic nature of the environment– services are updated and terminated constantly with new services being deployed all the time.
- The challenge was complex as the requirements dictate centralizing infrastructure/Kebernetes/ applications data, in real-time – while establishing clear segregation between the different components.
- Another primary requirement was tagging the data in a manner which allowed some data to be stored for long periods (compliance) and some for shorter periods (operational), in a lean manner to reduce AWS cost.
The Challenge & Requirements
The environment consists of multiple applications, servers and databases, located on both internal data centers and AWS.
- It was difficult to gather all the information due to the dynamic nature of the environment– services are updated and terminated constantly with new services being deployed all the time.
- The challenge was complex as the requirements dictate centralizing infrastructure/Kebernetes/ applications data, in real-time – while establishing clear segregation between the different components.
- Another primary requirement was tagging the data in a manner which allowed some data to be stored for long periods (compliance) and some for shorter periods (operational), in a lean manner to reduce AWS cost.
The Solution
All the data was shipped to XpoLog in real time. XpoLog deployed as a cluster on several AWS EC2 instances, with multiple listeners interfaces, receiving data from all sources while automatically tagging the data and building a clear structure of the environment.
The company’s teams are able to easily view data from all their services and gain important insights in real time, and meet compliance regulations as required.
XpoLog’s support of AWS spot instances saves 90% of hardware costs while maintaining the crucial flexibility of the cluster to dynamically scale up/down based on the processed data.
Considering streamlining your IT/cloud data management and analysis?
Need to streamline your IT/cloud data management and analysis?