Senior Data Engineer
USD 43K Senior-level Full Time
Tasks
- Apply data governance and PII handling
- Automate CI CD with Git and Databricks Asset Bundles
- Build Unity Catalog assets
- Deliver projects using Agile
- Design ETL/ELT pipelines
- Enable cross cloud data movement
- Implement audit and control tables
- Ingest and transform data
- Model data with Delta Lake
- Orchestrate workflows with Databricks Jobs and DLT
- Prepare AI ML ready datasets
- Troubleshoot pipeline and data quality issues
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Agile | Apache Spark | Asset bundles | Audit Tables | Auto Loader | Azure | Azure Databricks | CDC | CI/CD | DLT | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Databricks (asset) | Databricks Asset Bundles | Databricks Jobs | Databricks Workflows | Delta Lake | Delta Sharing | ELT | ETL | Embeddings | Feature Engineering | Feature Stores | Git | JDBC | Liquid clustering | Operational Metadata | Optimize | PII | Partitioning | Power BI | PySpark | SQL | Spark Structured Streaming | Structured Streaming | Tableau | Unity Catalog | Vector Search | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Analytics | Bachelor of Science in Computer Science | Bachelor of Science in Data Science | Bachelor of Science in Information Technology | Bachelor of Science in Statistics
Roles
Related jobs
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN4h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageSenior-level Full TimePune, India5h ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India5h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud Computing | Code review | Data Modeling | Database DesignSenior-level Full TimePune, India5h ago
-
Mid-level Full TimePune, India5h ago
-
Associate Software Engineer INR 1300K-2000KAgile | Design Patterns | JavaScript | Python | REST APIMid-level Full TimePune, India5h ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Data Modeling | Database Design | Design PatternsMid-level Full TimePune, India5h ago
-
Tech Lead Data Engineer INR 1500K-2600KAWS Data | AWS Glue | AWS data warehousing | Amazon Athena | Amazon EKSGreat Place to Work recognitionSenior-level Full TimePune, India5h ago
-
Senior-level Full TimePune, India5h ago
-
Data Engineer INR 1500K-2500KAWS Glue | Agile methodology | Amazon Athena | Amazon EMR | Amazon KinesisMid-level Full TimePune, India5h ago
-
Senior Software Engineer INR 1500K-3000KAgile | Cloud services | Code review | Data Modeling | DatabaseSenior-level Full TimePune, India5h ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 1860K-3900KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureSenior-level Full TimeRemote - India R5h ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R5h ago
-
Embedded C++ & PLC Automation Engineer-EPS1 INR 1716K-2700KC++ | C++17 | CAN | Embedded Systems | EtherCATSenior-level Full Timebangalore, India6h ago
-
Embedded C++ & PLC Automation Engineer-EPS1 INR 1716K-2700KBuild systems | C++ | C++17 | CAN | Case DevelopmentSenior-level Full Timebangalore, India6h ago
-
Senior AI-ML Platform Engineer / Tech Lead INR 2500K-5000KAI Foundry | API Gateway | API Keys | AWS Bedrock | AWS CloudFormationInclusion and Belonging CultureSenior-level Full TimeBangalore, Karnataka, IN, 5601006h ago
-
Senior-level Full TimeHyderabad R6h ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Professional growth | Remote workMid-level Full TimeIndia R7h ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, India8h ago
-
Staff Engineer (Cloudera CDP & Hadoop Administration) INR 1500K-3300KAnsible | ArgoCD | Automation | CI/CD | Cloudera CDPSenior-level Full TimeBengaluru, India8h ago
-
CI/CD | Claude | Code Analysis | Code modernization | Code remediationBusiness resource groups | Career progression | Disability insurance | Employee stock purchase plan | Family leaveSenior-level Full TimeIndia R8h ago
-
API Development | AWS EMR | Amazon EC2 | Amazon IAM | Amazon S3Flexible paid time off | Professional growth opportunities | Remote work from India | Stock grantsSenior-level Full TimeIndia R8h ago
-
AWS | Agile | Azure | Debugging | Deep learningConference access | Financial and legal consultation support | Internal mobility | Language learning resources | Learning and development initiativesSenior-level Full TimeIndia R11h ago
-
AWS | Agent Serving | Ansible | Argo CD | ArgoCDSenior-level Full TimeBangalore (SDC) - Bagmane Tech Park, …13h ago
-
Senior-level Full TimePune, IN13h ago