Data Engineer 2
IND-CORP Bengaluru-TDIM - PTT, India
INR 1000K-2000K (estimate) Mid-level Full Time
Tasks
- Build data pipeline frameworks
- Create automated tests for data pipelines
- Define data ingestion architecture
- Design develop maintain cloud based data infrastructure
- Document data infrastructure and pipelines
- Integrate tests into testing frameworks
- Optimize data pipeline performance
- Stay updated with cloud data engineering best practices
- Troubleshoot data processing issues
- Troubleshoot data quality issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Acceptance Testing | Amazon Redshift | CI/CD | Cloud Computing | Cloud platform | Data Governance | Data Lakes | Data Warehouses | Databricks | Dimensional Modeling | ETL | Functional testing | GitHub | Google BigQuery | Google Cloud | Google Cloud Platform | Integration Testing | Microsoft Azure | PySpark | Python | REST | SQL | Security Testing | Snowflake | Spark | System Testing | Unit Testing | User Acceptance | User Acceptance Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Azure Data & Fabric Developer / ETL pipeline & SQL ( 5 + yrs Assistant Manager - RNA INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, MH, India3h ago
-
Senior Data Engineer INR 2800K-4000KAWS Elastic MapReduce | Agile | Apache Spark | Business Intelligence | Data WarehousingAnnual health check eye checkup dental screening OPD reimbursement | Employee assistance program | Free transportation | Leave policy | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2500K-3630KAWS | Apache Spark | Azure | Computer Vision | Convolutional Neural NetworksSenior-level Full Timebengaluru, India7h ago
-
Custom Software Engineer INR 1400K-1848KAirflow | CI/CD | Cause analysis | Change Management | Control-MRotational shifts | Stakeholder communicationMid-level Full TimeBengaluru, BDC7A, India10h ago
-
Mid-level Full TimePLOT NO-1, S.NO. 77, India10h ago
-
.NET | ASP.NET | Amazon Web Services | Angular | Apache AirflowFlexible work arrangements | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India10h ago
-
IN_Senior Associate_SCM_Data and Analytics_Advisory_Bangalore INR 2040K-3380KAgile | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India10h ago
-
IN_Associate_Palantir_ Data and Analytics_Advisory_Bangalore INR 3000K-4000KAnalytics Cloud | Business Intelligence | Data Analysis | Data Mining | Data ModelingSenior-level Full TimeBengaluru Millenia, India10h ago
-
Gen AI Engineer / Applied AI Engineer INR 1800K-2500KAI Agents | Cloud Run | Embeddings | Gemini | Generative AIHands on experience with Vertex AI and Gemini ecosystem | Opportunity to work on production systems | Work on challenging problemsMid-level Full TimeGurugram, Haryana, India10h ago
-
Senior PySpark Data Engineer INR 2000K-2800KApache Airflow | CI/CD | Cloudera | Data Modeling | Data WarehousingSenior-level Full TimePLOT NO-1, S.NO. 77, India10h ago
-
Lead Engineer - Investment Data Platform INR 3000K-4000K.Net Framework | API Management | Agile | Apigee | AzureHybrid work | Work from office 3 days per weekSenior-level Full TimePune, India10h ago
-
AI Engineer, LLM Systems & Agentic Workflows GBP 97K-130KAgentic Workflows | Anthropic API | Constrained decoding | Evaluation Pipelines | Go100 percent remote | Employee referral bonuses | Flexible time off | Fun events | Room to growSenior-level Full TimeArgentina; Brazil; Chile; Colombia; Costa Rica; … R15h ago
-
Sr. AI engineer (Remote) USD 50K-120KAWS | AWS CloudWatch | AWS SageMaker | Apache Spark | CI/CDRemote workSenior-level Full TimeIndia, Remote R20h ago
-
Sr. Staff Machine Learning Engineer INR 3000K-4000KAWS | Agent Orchestration | Agent systems | Anomaly Detection | AzureEducation reimbursement | Health plans | Hybrid working model | Parental leave | Retirement optionsSenior-level Full TimeBangalore, IND21h ago
-
Senior-level Full TimeHyderabad, India21h ago
-
AI Engineer INR 2755K-4600KAI Safety | API Integration | Access Controls | Agent Orchestration | Data Leakage PreventionAsynchronous work | Continuous learning | High-performance culture | Knowledge sharing | Remote workSenior-level Full TimeRemote, Bangalore R21h ago
-
Agile | Confluence | Data Analysis | Jira | KanbanEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India21h ago
-
Senior-level Full TimeIN-KA-Bangalore22h ago
-
Senior Consultant INR 1900K-2600KAWS Lambda | Agile | Alerting | Amazon Web Services | Apache SparkGlobal team collaborationSenior-level Full TimeIN-KA-Bangalore22h ago
-
Data Engineer INR 3000K-4000KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | AirflowBereavement leave | Breakout areas | Casual leave | Enhanced parental coverage | Floating holidaysMid-level Full TimeHyderabad, India22h ago
-
AI Engineer (Manager level) INR 1200K-1800KAI Search | Agile | Apache Spark | Azure AI | Azure AI SearchMid-level Full TimeHyderabad, India23h ago
-
ML Engineer (Data) INR 1500K-2000KAmazon SageMaker | Apache Spark | BERT | CI/CD | CachingCoaching | Hybrid work | Learning opportunities | Mentoring | Paid volunteer dayMid-level Full TimeBengaluru23h ago
-
Senior AI Engineer INR 2500K-4000KAPI Gateway | API Integration | AWS CloudFormation | AWS Lambda | Amazon ECREmployee assistance program | Flexible work | Free Apps Access | Free Economist subscription | Free Podcasts AccessSenior-level Full TimeGurugram R23h ago
-
Senior AI Engineer INR 2500K-4000KAPI Gateway | AWS Lambda | Agile | Airflow | Amazon ECRAnnual leave | Employee assistance program | Flexible working | Free access to Economist content | Moving home supportSenior-level Full TimeBengaluru, Karnataka, India R23h ago
-
APIs | AWS | Automated testing | Azure | ClassificationEducational assistance | Flexible working hours | In-house soft skills training | Medical insuranceSenior-level Full TimeRemote - India R23h ago