Data Engineer
Chennai, Tamil Nadu
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Analyze legacy data warehouse systems for migration to Databricks
- Collaborate on source to target mapping requirements
- Conduct code reviews and follow data engineering best practices
- Design and develop scalable ETL/ELT pipelines
- Document migration logic transformation rules and dependencies
- Ingest transform validate and reconcile enterprise data
- Interpret complex T-SQL scripts and stored procedures
- Migrate SQL T-SQL transformation rules to Databricks and PySpark
- Optimize PySpark jobs SQL queries and Databricks notebooks for performance
- Perform data quality checks unit testing integration testing and defect resolution
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Ingestion | Data Lineage | Data Modeling | Data Quality | Data Security | Data Transformation | Data Warehousing | Data pipeline | Databricks | Delta Lake | Dimensional Modeling | ELT | ETL | Integration Testing | PySpark | SQL | Synapse Analytics | T-SQL | Unit Testing | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Full Stack Analytics Engineer INR 1500K-3000KAirflow | Amazon Redshift | Azure Synapse | CI/CD | Cloud ComputingSenior-level Full TimeMumbai, India3h ago
-
POD Engineers (Jr) INR 1500K-2000KAWS S3 | Amazon Web Services | Apache Kafka | Apache Spark | AzureIn office attendance as needed | Travel required 25 percentMid-level Full TimePune, MH, IN5h ago
-
Member of Technical Staff 3 INR 1500K-3000KAutomation | Cloud Architecture | Computing Services | Design Patterns | Integration TestingSenior-level Full TimeBengaluru, India5h ago
-
AI / ML Data Scientist (Across levels) INR 2520K-4580KAPI Development | AWS | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBangalore, India5h ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 3242K-4500KAWS | Agent systems | Apache Spark | Azure | DspyRemote workSenior-level Full TimeRemote - India R6h ago
-
Senior Machine learning Engineer INR 4000K-5500KAzure | Azure Blob | Azure Blob Storage | Azure ML | Blob StorageSenior-level Full Timebangalore, India6h ago
-
Senior AI Engineer INR 2500K-5000KAI Search | AWS SageMaker | Apache Airflow | Apache Kafka | Azure AICertification cost support | Dynamic career growth | Informal peer learning sessions | Innovation time | MentorshipSenior-level Full TimeHyderabad, TS, India6h ago
-
Senior Data Engineer - Advertising Engineering INR 2475K-3465KAWS | Access Control | Apache Airflow | Apache Spark | AuditabilityFinancial wellness support | Flexible remote work | Mental health support | Time offSenior-level Full TimeBengaluru, India8h ago
-
Senior-level Full TimeNew Delhi, India12h ago
-
Mid-level Full TimeBangalore, India12h ago
-
Industry Consulting Manager INR 1000K-1500KAPI Design | API Gateway | AWS CDK | AWS IAM | AWS LambdaMid-level Full TimeHyderabad, TG, IN12h ago
-
Data & AI Scientist INR 2500K-5000KABAC | Airflow | Audit Logging | Azure Machine Learning | CI/CDFlexible working | Hybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India12h ago
-
Senior-level Full TimePune, Gera Commerzone SEZ, India12h ago
-
Airflow | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India18h ago
-
Data Platform Engineer INR 1500K-3000KAWS IAM | AWS KMS | AWS S3 | AWS Secrets | AWS Secrets ManagerSenior-level Full TimeRemote - India R21h ago
-
Fullstack Software Engineer - Embedded Payments INR 1392K-2437KAPI Gateway | AWS | Agile | Apple Pay | Bitbucket PipelinesDiversity and inclusion initiatives | Flexible working arrangements | Mental health support | Paid parental leave | Paid volunteer daysMid-level Full TimePune, MH, India R21h ago
-
Senior Data Engineer- AWS INR 2000K-2500KAWS Glue | AWS Lambda | Amazon Redshift | Amazon Web Services | Apache AirflowSenior-level Full TimeBangalore North, India22h ago
-
Data Engineer INR 3584K-5449KAWS Bedrock | Columnar Databases | Copilot Studio | Dashboarding | Data CatalogingSenior-level Full TimeBengaluru, KA, India23h ago
-
Mid-level Full TimeBengaluru23h ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R23h ago
-
Senior-level Full TimeIN-KA-Bangalore23h ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R23h ago
-
Platform Engineer – Disaster Recovery & Capacity INR 2755K-2772KAWS | Agile | Azure | Capacity Management | Capacity PlanningMid-level Full TimeGurugram, India23h ago
-
AWS | Active clustering | Active-Active Clustering | Active/Active | AnsibleSenior-level Full TimeGurugram, India1d ago
-
Consultant - Cloud AI Developer INR 1400K-2500KAWS | Application Modernization | Application rationalization | Azure | Azure OpenAIMid-level Full TimeBangalore, Karnataka, India1d ago