Data Engineer
Hyderabad, India
Quantela Inc.
We are a technology company that offers outcomes business models. We empower our customers with the right digital infrastructure to deliver greater economic, social, and environmental outcomes for their constituents.
When the company was founded in 2015, we specialized in smart cities technology alone. Today, working with cities and towns, utilities, and public venues, our team of 280+ experts offer a vast array of outcomes business models through technologies like digital advertising, smart lighting, smart traffic, and digitized citizen services.
We pride ourselves on our agility, innovation, and passion to use technology for a higher purpose. Unlike other technology companies, we tailor our offerings (what we can digitize) and the business model (how we partner with our customers to deliver that digitization) to drive measurable impact where our customers need it most. Over the last several months alone, we have served customers to deliver outcomes like increased medical response times to save lives, reduced traffic congestion to keep cities moving, and created new revenue streams to tackle societal issues like homelessness.
We are headquartered in Billerica, Massachusetts, in the United States with offices across Europe and Asia.
The company has been recognized with the World Economic Forum’s ‘Technology Pioneers’ award in 2019 and CRN’s IoT Innovation Award in 2020.For the latest news and updates, please visit us at www.quantela.com
Overview of the roleWe are seeking a passionate and skilled Senior Software Engineer who excels in backend development using Python and has a strong foundation in data engineering, cloud platforms (AWS/Azure), and modern application design. You will work on scalable microservices, real-time data pipelines, and AI-driven reporting platforms using LLMs and agentic AI for product development.
Roles and responsibilities
- Design, develop, and maintain backend services and REST APIs using Python (FastAPI preferred).
- Build and optimize data pipelines, ETL workflows, and data lake/lakehouse architectures.
- Work with cloud infrastructure (AWS/Azure) for deployment, scaling, and data services.
- Develop and manage Superset-based dashboards and reporting workflows.
- Implement microservice-based architectures and containerized deployments (Docker/Kubernetes).
- Apply database design principles, write performant queries, and manage relational/columnar DBs.
- Integrate LLM-based intelligence into product features using OpenAI or open-source models.
- Architect and orchestrate agentic AI systems that perform reasoning, action selection, and multi-step workflows.
- Collaborate with cross-functional teams, including product managers, analysts, and frontend developers.
- Follow best practices in CI/CD, testing, monitoring, and documentation.
- Strong expertise in Python backend development (FastAPI, Flask, etc.)
- Experience with SQL, data modeling, and relational/columnar databases (PostgreSQL, Snowflake, etc.)
- Experience building ETL/data pipelines using tools like Pandas, PySpark, or Apache Airflow.
- Good ot have - Hands-on experience with Superset for reporting and custom dashboard development.
- Working knowledge of AWS (Lambda, S3, RDS, EC2) or Azure (Functions, Blob Storage, CosmosDB).
- Solid understanding of microservices architecture and containerization (Docker, Kubernetes).
- Good grounding in LLMs, embeddings, vector stores, and AI agent orchestration frameworks (LangChain, LlamaIndex, etc.)
- Familiarity with software development best practices (unit testing, logging, code reviews, Git).
- Knowledge of event-driven architectures (Kafka, Redis Streams, etc.)
- Exposure to DevOps tools like GitHub Actions or Jenkins.
- Experience deploying AI services to production at scale.
- Open-source contributions or blog posts on AI/ML/Data topics.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture AWS Azure CI/CD Data pipelines DevOps Docker EC2 Engineering ETL FastAPI Flask Git GitHub Jenkins Kafka Kubernetes Lambda LangChain LLMs Machine Learning Microservices OpenAI Open Source Pandas Pipelines PostgreSQL PySpark Python Snowflake SQL Superset Testing
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.