Senior Engineer ( Data Platform )

About Velotio:

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We have provided full-stack product development for 110+ startups across the globe, building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 400+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements

• Optimize Spark clusters for cost, efficiency and performance by implementing robust monitoring systems to identify bottlenecks using data and metrics. Provide actionable recommendations for continuous improvement.
• Optimize the infrastructure required for extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies .
• Work with data and analytics experts to strive for greater cost efficiencies in our data systems.
  

You will enjoy this role if you..

• Experience with processing large workloads and complex code on Spark clusters.
• Proven experience in setting up monitoring for Spark clusters and driving optimization based on insights and findings.
• Experience in designing and implementing scalable Data Warehouse solutions to support analytical and reporting needs.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

Desired Skills & Experience:

• 4+ years of experience in Data Platform.
• Expertise with Python and Jupyter notebooks is a must.
• Experience with big data tools: Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
• Working knowledge of stream-processing systems: Storm, Spark-Streaming, etc. is a plus

Benefits

Our Culture:

• We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly.
• Flat hierarchy with fast decision making and a startup-oriented “get things done” culture.
• A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment.

We want to hire smart, curious, and ambitious folks, so please reach out even if you do not have all of the requisite experience. We are looking for engineers with the potential to grow!

At Velotio, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.