Senior Data Engineer - Full Stack
Tasks
- Build batch incremental and streaming pipelines
- Build end-to-end data products
- Create dashboards and user interfaces
- Create scalable data models and curated datasets
- Design event-driven architectures
- Design, develop, and maintain data pipelines
- Develop backend REST APIs and integrations
- Implement data quality security lineage and governance
- Lead technical design and code reviews
- Mentor engineers
- Optimize pipelines queries streaming workloads and APIs
- Prototype validate and transition to production
- Set up automated testing CI CD monitoring and deployment
- Troubleshoot issues across systems and consumers
Perks/Benefits
- Education and learning support
- Generous time off
- Professional growth
- Remote work
- Wellness and lifestyle resources
Skills/Tech-stack
AWS | Agile | Apache Spark | Azure | CI/CD | Data Modeling | Data Observability | Data Warehousing | Databricks | Delta Lake | Distributed Processing | Docker | Event Hubs | FastAPI | Flask | GCP | Git | Infrastructure as Code | Kafka | Kinesis | Monitoring | PySpark | Python | REST APIs | React | SQL | Schema evolution | Scrum | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R1d ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE) R1d ago
-
AI safety & Security controls, LLM Guardrails/Associate Director, Software Engineering Specialist INR 1400K-2400KAPI Development | Asynchronous processing | Audit trails | Cloud Computing | Content SafetyCareer development | Flexible working | Inclusive cultureMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
AI Architect / Sr. AI Engineer INR 2000K-5000KAnthropic Claude | CI/CD | Chroma | Django | Django RESTRemote workSenior-level Full TimePune R1d ago
-
Data Engineer Consultant Senior INR 3000K-4000KAgile | Alerting | Auditability | Automated testing | AzureBike to work | Career mentorship | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R1d ago
-
Data Engineer Consultant Principal INR 3000K-4000KAccess Control | Agile | Audit and compliance | Auditability | Automated testingBike to work | Career progression mentorship | Educational assistance | Employee assistance programme | Employee discount schemeSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior Engineer- Fullstack INR 2500K-5140KAPIs | Access Control | Backend Services | Data Access Control | Data ModelingHybrid work model | In-office collaborationSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
API Integration | Agent Orchestration | CI/CD | Change Management | Confidence scoringFlexible working | Inclusive work environment | Professional development opportunitiesMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Software Development Specialist INR 940K-940KAmazon CloudWatch | Amazon DynamoDB | Amazon S3 | Amazon Web Services | Azure DevOpsMid-level Full TimeBangalore, KA, IN R1d ago
-
Group Data Engineer I INR 1500K-2600KAWS | AWS CloudFormation | Agile | Apache Airflow | Apache SparkSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
AI Security | Agent systems | Backend Development | Claude API | FastAPIContract engagement | Fully remote work | International technology focused environmentSenior-level Full TimeIndia R1d ago
-
Senior Manager INR 1500K-2800KAWS Glue | AWS Secrets | AWS Secrets Manager | Adaptive Query | Adaptive query executionHybrid work modeSenior-level Full TimePune, Maharashtra, India R1d ago
-
Airflow | BigQuery | CI/CD | Cloud SQL | Cloud StorageContinuous professional development | Flexible working | Inclusive and diverse environment | Opportunities to grow within the organizationMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Java API & Microservices Engineer / Architect INR 2500K-3500KAPI Testing | Azure | CI/CD | Cassandra | DatadogSenior-level Full TimeBangalore, KA, IN R2d ago
-
Senior-level Full TimeBangalore, KA, IN R2d ago
-
Lead Data Engineer INR 3000K-4000KAPI | Agile | Amazon Web Services | Azure | Azure SynapseHybrid workSenior-level Full TimeIN025 Embassy Manyata Business Park, India R2d ago
-
Senior Data Platform Engineer INR 1500K-3000KARM Templates | AWS | Azure DevOps | Azure DevOps Services | Azure EntraHybrid workSenior-level Full TimeIN025 Embassy Manyata Business Park, India R2d ago
-
Senior DevOps Engineer INR 3000K-4000KAlerting | Apache Spark | BigQuery | CI/CD | DataflowFlexible working | Hybrid workingSenior-level Full TimeHyderabad Knowledge City (LTC), India R2d ago
-
Audio signal processing | Essentia | Librosa | MuseScore | Music NotationFlexible schedule | Fully remoteSenior-level Contract Full TimeIndia - Remote R2d ago
-
3D CAD | 3D Solid Modeling | Build123d | CAD automation | CadQueryRemote workSenior-level Contract Full TimeIndia - Remote R2d ago
-
Software Engineer (Backend Engineer) - Bengaluru INR 2500K-5000KAWS | AWS Aurora | Amazon MSK | Backup and Restore | CI/CDSenior-level Full TimeIndia-Bangalore-Office-Kalyani Vista R2d ago
-
Entry-level Full Time(HE)Office Commerzone, India R2d ago
-
AI Engineer USD 95KDebugging | Machine Learning | Python | Software testingHybrid work environment | Professional development | Remote work flexibilitySenior-level Full TimeGurugram - Good Earth, India R2d ago