Senior Data Engineer - Full Stack (US, Remote)
Maharashtra, Pune, India
R
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Automate Databricks jobs deployment and scheduling
- Build and maintain automation tools and scripts
- Build internal dashboards and tools
- Demonstrate model inference capabilities
- Design and develop CLI tools
- Develop testing frameworks for pipelines
- Execute integration testing
- Implement MLOps workflows with APIs
- Implement data governance workflows
- Monitor data pipeline productivity
- Orchestrate data pipelines
- Perform environment setup and configuration
- Provide configuration and operational controls
- Provision environments
- Synchronize metadata
- Test and validate ML inference workflows
- Validate ETL ELT workflows
- Visualize data pipelines and workflows
Perks/Benefits
Skills/Tech-stack
API | AWS | CI/CD | CLI | Data Governance | Databricks | Databricks SDK | ELT | ETL | End to End | End-to-End Testing | Integration Testing | MLOps | Metadata Management | Python | React | Spec Driven Development | Streamlit | Terraform | Testing | Version control
Education
N/A
Roles
Related jobs
-
Lead Data Integration Engineer INR 2000K-3000KAgile Scrum | CI/CD | Data Lake | Data Modeling | Data PipelinesHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefits | Personal/family careSenior-level Full TimeChennai, India R16h ago
-
Senior Data Engineer - Remote INR 2520K-3380KAWS Athena | AWS CloudWatch | AWS Glue | AWS IAM | Amazon SQSFlexible schedule | Night shift flexibility | Remote workSenior-level Full TimeChennai, TN, IN R21h ago
-
Software Engineering Expert (AI Training) USD 200K-460KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFast onboarding | Flexible contractor schedule | Remote workMid-level Contract Full TimeIndia - Remote R23h ago
-
Computer Scientist II INR 3000K-3500KAPI | Authentication | CI/CD | Code review | Distributed SystemsSenior-level Full TimeNoida, India R23h ago
-
Sr. ML Engineer INR 3470K-4500KADLS | AKS | Apache Spark | Azure | Azure DataFull-time employment | Mentoring | Remote workSenior-level ContractIndia - Remote R23h ago
-
Senior Software Engineer (India) INR 3000K-4200KAWS | AWS CDK | Asyncio | CI/CD | DatadogRemote work opportunity | Work from homeSenior-level Full TimeIndia - Remote R23h ago
-
Mid-level Full TimeRemote, India R23h ago
-
Data Engineering Senior Analyst - HIH - Evernorth INR 2771K-3500KAWS | Data Governance | Data Lake | Data Modeling | Data QualityRemote work flexibilitySenior-level Full TimeHIH - Hyderabad, India R23h ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Senior-level Full TimeNoida,UP,India R1d ago
-
AWS | Apache Spark | Asynchronous programming | Azure | ChromaDBAccidental death and dismemberment coverage | Dental insurance | Flexible paid time off | Health insurance | Life insuranceMid-level Full TimeIndia R1d ago
-
Data Engineer INR 2400K-3500KApplication Insights | Azure Data | Azure Data Factory | Azure RBAC | DAXRemote workSenior-level Full TimeIndia, India R1d ago
-
Staff Forward Deployed Engineer INR 2500K-3900KAWS | Apache Kafka | Apache Spark | Architecture Design | AutomationSenior-level Full TimeRemote - India R1d ago
-
Data Compliance | Data Governance | Data Ingestion | Data Modeling | Data PipelinesCareer development | Continuous learning | Fitness support | Flexible work location | Generous time offSenior-level Full TimeIndia R1d ago
-
AWS | Anomaly Detection | Clustering | DBT Cloud | DBT CoreAutonomy | Flexible working schedule | Fully remote work | High-impact role | International team collaborationSenior-level Full TimeIndia R1d ago
-
AI Platform Engineer / Senior Consultant Specialist INR 3000K-5000KAPI Development | Ansible | Batch inference | CI/CD | DockerSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
Senior Machine Learning Engineer INR 3000K-4200KAWS | Airflow | Azure | Azure ML | Batch inferenceHybrid work | Remote workSenior-level Full TimeBengaluru, India R1d ago
-
Principal Specialist- Data Science Customer Programs INR 3000K-4000KApache Spark | Data Engineering | Data Governance | Data Lineage | Data ModelingHybrid work environment | UK shift working hoursSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R1d ago
-
Data Engineer II INR 1000K-2000KAmazon S3 | Apache Kafka | Apache Spark | CDC | CI/CDAutonomy | Inclusive and diverse environment | Learning stipend | Mentorship | Remote environmentMid-level Full TimeIndia - Remote R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
AVP, Data Engineer (L10) INR 3000K-4000KAPI | AWS | AWS Glue | Amazon EMR | Amazon RedshiftCareer advancement | Flexible working hours | Remote work | Upskilling opportunities | Work-life flexibilityExecutive-level Full TimeHyderabad IN, India R1d ago
-
Senior AI/ML Engineer INR 2000K-5000KAWS | Agent systems | Cloud Platforms | Conversational AI | Distributed SystemsAugust Free Fridays | Education support | Flexible working arrangements | Leadership development | Learning programsSenior-level Full TimeHyderabad (Flexible), India R1d ago
-
Analyst - Data Analytics INR 800K-2000KAgile | CI/CD | Data Governance | Data Modeling | Data QualityHybrid work | Learning and development programs | Two-way transportationMid-level Full TimeHyderabad GBS, India R1d ago
-
VP - Senior Data Engineer (Python/Snowflake/Apache Airflow) INR 3845K-5500KAWS | Agile | Apache Airflow | Apache Iceberg | Apache KafkaComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Python Data Engineer, Aladdin Data, Associate INR 1500K-2700KAgile | Apache Airflow | Azure | Azure Data | Azure Data LakeComprehensive healthcare | Flexible time off | Hybrid work | Retirement plan | Support for working parentsMid-level Full TimeHA3-Gurugram - DLF Cyber City, India R1d ago