Custom Software Engineer
Hyderabad, HDC4A, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Architect data platform blueprint
- Build and manage Delta Lake tables
- Design, build, and optimize data pipelines
- Develop coding testing and data engineering workflows
- Implement Lakehouse architecture
- Integrate and transform data with Azure services
- Maintain data architecture documentation
- Optimize pipeline performance
- Perform schema evolution and versioning
- Troubleshoot data quality and latency issues
Perks/Benefits
- N/A
Skills/Tech-stack
Analytics platform | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Key Vault | Azure Synapse | CI/CD | Data Factory | Data Lake Storage Gen2 | Data analytics platform | Databricks Unified Data Analytics Platform | Delta Lake | Delta Lake Tables | Git | Key Vault | Lakehouse Architecture | PySpark | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
CI/CD | Cloud Platforms | Data Architectures | Data Engineering | Data ModelingHybrid work | Immediate join | VIRTUAL interviewMid-level ContractBangalore North, India8h ago
-
Software Engineer (2024 / 25, GenAI must) INR 1100K-1500KAgile | CI/CD | Deep learning | Full SDLC | Generative AIHybrid work | MentorshipMid-level Full TimeBengaluru, INDIA, India10h ago
-
Lead BI Engineer (GenAI) INR 2500K-3380KAI Agents | Azure SQL | DAX | Data Modeling | Data WarehousingCareer growth | Certification support | Growth chats | Idea tanks | MentorshipSenior-level Full TimeHyderabad, TS, India10h ago
-
Lead - Data Platform Engineering INR 2040K-2400KAlerting | Automation | Bash | CPU | Concurrency ControlSenior-level Full TimeChennai, India11h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India11h ago
-
Gen AI - Consultant INR 2500K-4500KAWS SageMaker | Apache Airflow | Azure Machine Learning | CI/CD | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India12h ago
-
Gen AI - Consultant INR 2500K-4500KAPI Design | AWS SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to AI research labs and cloud platforms | Certification access | Mentoring opportunities | Work on global clientsSenior-level Full TimeBangalore, Karnataka, India12h ago
-
Software Engineer III-( Java, AWS & Pyspark ) INR 2000K-2200KAWS | AWS Athena | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeMumbai, Maharashtra, India13h ago
-
Senior-level Full TimeBengaluru, Karnataka, India14h ago
-
Assistant Vice President INR 240K-420KData Analysis | Data Science | Machine Learning | Model Deployment | PythonExecutive-level Full TimeIndia14h ago
-
Senior Data Engineer INR 2500K-2829KAWS | Apache Airflow | Apache Iceberg | Apache Spark | AzureEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India14h ago
-
Data & AI DevSecOps Specialist INR 2298K-2675KAccess Control | CI/CD | Cloud platform | Data Classification | Data PrivacySenior-level Full TimeBengaluru, IN, 56010314h ago
-
Data Engineering INR 2520K-3356KAWS | AWS CloudFormation | Amazon Redshift | Amazon S3 | Backup and RecoveryCode reviews | Continuous improvement | Mentoring and coaching | Onboarding support | Technical assessments participationSenior-level Full TimeIndia15h ago
-
Java Cloud Native Lead INR 1800K-2300KAWS Glue | Amazon ECS | Amazon Web Services | FastAPI | GitHub ActionsSenior-level Full TimeIndia15h ago
-
Lead Software Engineer - Python AWS Developer INR 2200K-3500KAPI Versioning | AWS SDK | AWS SDK for Python | AWS Secrets | AWS Secrets ManagerCareer growth | Collaborative team environment | Community of practice involvement | Mentorship | Technology adoption opportunitiesSenior-level Full TimeMumbai, Maharashtra, India16h ago
-
Azure Lead Data Engineer INR 2000K-2000KAzure Cloud | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeChennai, Tamil Nadu, India16h ago
-
Senior-level Full TimeHyderabad, Telangana, India16h ago
-
Apprentice Software Engineer INR 302K-540KAWS | Azure | BigQuery | Cloud Computing | Data ComplianceContinuous improvement initiatives | Mentoring | Shift handovers | Structured learning sessionsEntry-level Apprenticeship Full TimeChennai, Tamil Nadu, India16h ago
-
AWS Glue | Amazon Redshift | Amazon S3 | Apache Airflow | Apache BeamMid-level Full TimeBengaluru, INDIA, India17h ago
-
Azure Databricks | BigQuery | CI/CD | DAX | Data ModelingSenior-level Full TimeBangalore, KA, India17h ago
-
Product Evangelist - GEXL INR 1500K-2000KAmazon Redshift | Apache Hadoop | Apache Kafka | Apache Spark | ClouderaHybrid workSenior-level Full TimeTamil Nadu, Chennai, India18h ago
-
Lead Software Engineer - PySpark, BigData, AWS INR 2000K-2200KAWS | AWS CDK | AWS Lambda | Amazon DynamoDB | Amazon ECSSenior-level Full TimeHyderabad, Telangana, India18h ago
-
AI / ML Engineer INR 2500K-4500KApache Spark | Automated retraining | Azure Machine Learning | Batch Processing | Data PreprocessingSenior-level Full TimeBengaluru, BDC7C, India22h ago
-
AI / ML Engineer INR 2500K-4500KAPI Development | Azure Machine Learning | Batch Processing | Chatbots | Data PreprocessingSenior-level Full TimeBengaluru, BDC7C, India22h ago
-
AI / ML Engineer INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Machine Learning | CI/CDMid-level Full TimeBengaluru, BDC7C, India22h ago