Senior Data Engineer
Chennai, Tamil Nadu, India
A INR 2000K-2000K (estimate) Senior-level Full Time
Tasks
- Build data models and schemas
- Design data pipelines
- Develop data pipelines
- Extract data using APIs
- Extract data using webhooks
- Implement data governance and security
- Ingest real-time data streams
- Load data into ADLS Gen2
- Maintain data pipelines
- Mentor junior data engineers
- Optimize pipeline performance and cost
- Transform and clean data
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Azure Data | Azure Data Factory | Azure Databricks | Data Factory | Data Governance | Data Modeling | Data Processing | Data Security | Data Warehousing | Delta Lake | ELT | ETL | Java | Kafka | Python | REST APIs | Real Time | Real-time Data | Real-time Data Processing | SQL | Scala | Webhooks
Education
Roles
Related jobs
-
Principal Consultant, Backend Engineer (Python, FastAPI, GenAI) INR 2535K-4225KAPI Design | API Gateway | AWS | CI/CD | Distributed SystemsSenior-level Full TimeIndia-Pune2h ago
-
Lead Consultant, DevOps INR 2535K-4225KAgile | Ansible | Application Scaling | Application Security | BashSenior-level Full TimeIndia-Bangalore2h ago
-
Senior Customer and Product Solutions Engineer, Google AI INR 2500K-5000KAI Studio | C++ | CSS | Cloud platform | Data AnalysisSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India4h ago
-
Senior Software Engineer, AI/ML GenAI, Google Ads INR 2500K-5000KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Data Senior Engineer INR 2516K-3356KAlerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TG, IN8h ago
-
Technical Lead - Data Engineer (Databricks) INR 2800K-4000KAzure | Azure Databricks | Azure DevOps | CI/CD | DatabricksCertification programs | Corporate pension scheme | Dental and vision coverage | Education reimbursement programs | Employee assistance programSenior-level Full TimeTelangana, India9h ago
-
Senior Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India15h ago
-
Junior Professional AE Engineer INR 180K-180KAzure Cloud | Copilot Studio | Docker | Git | KubernetesEntry-level Full TimeMorinda, India15h ago
-
Software Engineering Senior Analyst - HIH - Evernorth INR 3200K-4725KAWS | Angular | CI/CD | CSS | Deep learningSenior-level Full TimeHIH - Hyderabad, India15h ago
-
Software Engineering Senior Analyst - HIH - Evernorth INR 2535K-3500KAWS | Agile | Amazon SageMaker | Angular | CI/CDFull-time position | Remote work flexibilitySenior-level Full TimeHIH - Hyderabad, India15h ago
-
Backend Engineer, Knowledge Graph (Rust) INR 3200K-4200KAPI Development | Alerting | Change Data Capture | ClickHouse | Data CaptureFlexible paid time off | Growth and development fund | Home office support | Parental leave | Team member resource groupsSenior-level Full TimeRemote, India R18h ago
-
Staff Backend Engineer, Knowledge Graph (Rust) INR 3384K-4590KCapacity Planning | ClickHouse | Data Modeling | Graph Data | Graph Data ModelingEquity compensation | Flexible paid time off | Growth and development fund | Home office support | Parental leaveSenior-level Full TimeRemote, India R18h ago
-
NAS Tech Ops - Cont 165771 INR 1500K-2000KDatabricks | Excel | Hyperion Essbase | Power BI | Power QueryMid-level Contract TemporaryPune, IND-MH, India23h ago
-
Staff Machine Learning Engineer INR 2600K-5000KAnomaly Detection | Apache Airflow | Apache Kafka | Apache Spark | Bias detectionSenior-level Full TimeBangalore23h ago
-
Staff Data Engineer INR 3200K-4600KAgentic Workflows | Airflow | Argo | Data Modeling | Data QualitySenior-level Full TimeBangalore23h ago
-
Senior Machine Learning Engineer INR 3100K-4500KA/B | A/B Testing | B testing | Cloud Computing | Data PipelinesSenior-level Full TimeHyderabad, Telangana, India23h ago
-
Senior Analytics Engineer INR 2940K-4170KAmazon Redshift | BigQuery | Data Modeling | Data Transformation | Data WarehousingCommunity benefits | Family benefits | Finance benefits | Health benefits | Relocation supportSenior-level Full TimeHyderabad - Main Office1d ago
-
Senior-level Full TimeMumbai, Maharashtra, India1d ago
-
Consultant Machine Learning Engineer INR 3380K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsMid-level Full TimeBangalore, India R1d ago
-
Business Intelligence Data Engineer INR 1524K-3000KAWS Glue | AWS Lambda | Access Control | Amazon Athena | Amazon RedshiftMid-level Full TimeHyderabad India1d ago
-
Applied AI ML Lead INR 2500K-3307KAWS | Algorithms | Amazon SageMaker | Apache Spark | Computer VisionSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimePune, MH, India1d ago
-
Entry-level Full TimeBangalore North, India1d ago
-
Principal Consultant- Snowflake INR 2040K-3285KAWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon EMRSenior-level Full TimeIndia-Bangalore1d ago
-
Senior-level Full TimeIN-TN-Chennai1d ago