Data Engineer Senior Consultant
Tasks
- Build dbt transformation models from mapping logic
- Create technical documentation and runbooks
- Design python extract load pipelines
- Develop dbt tests and Python unit tests
- Implement gitlab cicd for dbt and airflow
- Orchestrate python and dbt using airflow dag
- Perform peer code reviews
- Reconcile row counts between source and target
- Translate informatica powercenter workflows into python and dbt
- Troubleshoot data discrepancies and performance issues
Perks/Benefits
- N/A
Skills/Tech-stack
Aggregations | Apache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBT | Data Pump | GitLab CI | GitLab CI/CD | Informatica PowerCenter | Oracle Data | Oracle Data Pump | Pyodbc | Python | SQL | SQL Server | SQL Server BCP | SQLAlchemy | Window Functions
Education
N/A
Roles
Related jobs
-
Databricks Data Engineer (Databricks, PySpark, Cloud, MLOps) | 100% Remote | Contract 12 + Months | AS A INR 1500K-2600KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | DatabricksRemote workSenior-level Full TimeIndia, India R4h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkComplimentary games | Family leave | Health insurance | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India6h ago
-
Senior-level Full TimeHyderabad, India7h ago
-
Senior BI Engineer - Tableau & Python INR 3000K-4000KBusiness Intelligence | Data Modeling | Data Visualization | Data Warehousing | DatabricksCareer growth | Certification support | Flexible collaboration | Innovation time | MentorshipSenior-level Full TimeHyderabad, TS, India8h ago
-
Applied AI ML Senior Associate INR 3264K-5000KAWS | Azure | CI/CD | Cloud platform | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Associate Program Manager INR 2000K-4000KAI Agents | AI Foundry | AI Governance | AI orchestration | APIsMid-level Full TimeChandigarh, India8h ago
-
AI/ML Engineer INR 1860K-4000KAI Agent Builder | AI Pipelines | AI vector search | Agent Builder | AirflowMid-level Full TimeChennai, Tamil Nadu, India8h ago
-
GenAI Developer INR 1500K-2129KDeep learning | Docker | GenAI | Language Processing | Machine LearningWell-being focusEntry-level Full TimePune, Maharashtra, India9h ago
-
Senior-level Full TimeHyderabad, Telangana, India10h ago
-
Engineering-L2-Bengaluru-Analyst-Software Engineering INR 1500K-2500KApache Spark | Avro | CI/CD | Data Clustering | Data ModelingEntry-level Full TimeBengaluru, Karnataka, India10h ago
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India12h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India12h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India12h ago
-
Mid-level Full TimeMumbai, Maharashtra, India12h ago
-
Senior-level Full TimeMumbai, Maharashtra, India12h ago
-
Executive, R&D Injectable (AI/ML) INR 3000K-5000KAPIs | Anomaly Detection | Computer system | Computer system validation | Data AnalysisExecutive-level Full TimeAhmedabad City, Gujarat, India12h ago
-
Lead Software Engineer - Python and AI INR 3500K-6000KAI assisted code | AI-assisted code review | AWS ECS | AWS Lambda | Agent FrameworksSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Lead Data Engineer - Azure + Fabric INR 1200K-2700KAzure | Azure DevOps | CDC | CI/CD | Data GovernanceSenior-level Full TimeGurugram, Haryana, India13h ago
-
Databricks Engineer - Senior/ Lead INR 1500K-2800KACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India13h ago
-
Data Engineer - Azure + Fabric INR 1400K-2700KAccess Control | Apache Spark | Azure Data | Azure DevOps | Azure SynapseSenior-level Full TimeGurugram, Haryana, India13h ago
-
Mid-level Full TimeNoida R13h ago
-
Senior-level Full TimeIndia14h ago
-
Staff Software Engineer (Python) INR 3700K-5000KAPI Development | Alerting | Amazon Web Services | Authentication | Batch ProcessingCollaborative team environment | Global projects | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India14h ago
-
AI / ML Data Scientist I INR 1000K-1890KAWS | Apache Spark | Artificial Intelligence | Cloud platform | ConfluenceMid-level Full TimeBengaluru, India14h ago
-
Lead - Data Platform Engineering INR 2500K-4500KAWS | Azure | Cloud Data | Cloud Data Platforms | Customer 360Senior-level Full TimeChennai, India14h ago