Enterprise Data Solutions Engineer
Tasks
- Build data transformations using medallion architecture
- Collaborate with data analysts on requirements
- Develop and maintain ETL and ELT pipelines
- Document data pipelines and data flow
- Implement data quality checks and unit tests
- Optimize SQL queries stored procedures and views
- Participate in code reviews and sprint activities
- Troubleshoot data pipeline failures
- Write and test data processing code
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | CI/CD | DBT | Data Factory | Data Lake Storage | Data Quality | Data Quality Checks | Databricks | Delta Lake | ELT | ETL | Git | Great Expectations | Hudi | Iceberg | Medallion Architecture | PySpark | Python | Quality checks | SQL | SQL views | Stored Procedures | T-SQL | Unit Testing
Education
Roles
Related jobs
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R12h ago
-
AI / LLM Integration Engineer (Remote) INR 1800K-2800KAPI Integration | Anthropic SDK | Async APIs | Benchmarking | Confidence scoring100 percent remote | Collaborative culture | Inclusive team culture | Professional growthMid-level Full TimeMaharashtra, Pune, India R12h ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R12h ago
-
Data Operations Engineer INR 2040K-3380KApache Airflow | Data Pipelines | Data Refresh | Data Warehousing | Data pipelineEmergency incident response support | On-call rotationSenior-level Full TimeBengaluru, INDIA, India R20h ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | JavaScript100 percent remote | Autonomous work environment | Career growth opportunities | Flexible work environment | International team cultureMid-level Full TimeIndia R21h ago
-
Machine Learning Engineer - 5 INR 2500K-4500KAWS | AWS SageMaker | Airflow | Argo Workflows | Azure Machine LearningSenior-level Full TimeBangalore, India R1d ago
-
Computer Scientist ( Java Backend ) INR 3000K-4725KApache Kafka | CI/CD | Distributed Systems | Docker | Event DrivenSenior-level Full TimeBangalore, India R1d ago
-
Business Technology Analyst INR 3000K-4000KAWS | AWS Athena | AWS Glue | Airflow | Amazon RedshiftHeadspace access | Hybrid work | Mental health days | Retirement savings | Tuition reimbursementSenior-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Software Engineer INR 1500K-2362KAWS | Apache Flink | Apache Spark | Linux | PythonHybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (IND), India R1d ago
-
Junior GenAI Developer INR 500K-600KAWS | Embeddings | Git | Hybrid search | Language ModelsCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesEntry-level Full TimeAll Cities, India R1d ago
-
Junior GenAI Developer INR 500K-600KAWS | Embeddings | Git | Hybrid search | Language ModelsHealth insurance | Language courses | Mentorship | Professional development | Relocation programEntry-level Full TimeAll Cities, India R1d ago
-
Tech Lead - Gen AI with 6+ Years(Remote) INR 2500K-5000KAWS | Chatbot | Computer Vision | Dialogue flow | Distributed ComputingRemote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Sr. Engineer - Gen AI with 4+ years(Remote) INR 2500K-5000KAWS | Audio Processing | Azure | Computer Vision | Distributed ComputingExtendable contract | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Software Development Engineer I INR 2139K-4500KCI/CD | Code review | Data Structures | Data Structures and Algorithms | ElasticsearchProfessional development | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS Lambda | Agile | Amazon CodeDeploy | Amazon LinuxGreat place to work | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | AWS SDK | AgileGreat place to work | PradeepIT Academy training | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS Lambda | Agile | Amazon Linux | AnsibleRemote work opportunitySenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | AWS SDK | AgileRemote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | Agile | Amazon LinuxCareer acceleration | Remote work | Training and academy coursesSenior-level Full TimeBengaluru, KA, India R1d ago
-
Python Backend Engineer INR 2800K-4200KBackend Development | MySQL | Python | Web developmentContinuing education | Remote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Pyspark & Databricks certified Developer INR 1632K-2300KAWS | Apache Spark | Azure | Azure Databricks | Data IngestionRemote workSenior-level Full TimeMumbai, MH, India R1d ago
-
Principal Engineer (Big Data Engineer) INR 2800K-4500KAmazon Web Services | Apache HBase | Apache Spark | Cassandra | Cloud platformRemote work flexibilitySenior-level Full TimeBengaluru, KA, India R1d ago
-
Oracle + PySpark Data Engineer (Remote) INR 1500K-2500KData Modeling | Data Quality | Data Warehousing | Distributed Computing | ETLDocumentation support | Remote workMid-level Full TimeBengaluru, KA, India R1d ago
-
Lead Software Engineer (Python) INR 2000K-4000KAPI Gateway | AWS | AWS IAM | AWS Lambda | AiohttpRemote workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Lead Software Engineer (Big Data and Azure) INR 2040K-3500KAgile | Apache Kafka | Apache Spark | Apache Storm | Azure BlobCareer growth | Great Place to Work certification | Remote work | Training coursesSenior-level Full TimeBengaluru, KA, India R1d ago