Big Data Engineer
Tasks
- Build data migration pipelines to BigQuery
- Convert Teradata SQL to BigQuery
- Design ETL ELT pipelines on GCP
- Develop Cloud Composer orchestration workflows
- Develop Python based GCP pipelines
- Document pipeline logic and operational procedures
- Ingest transform and load data into BigQuery
- Optimize BigQuery query and pipeline performance
- Perform data validation reconciliation and testing
- Troubleshoot pipeline failures and ensure production stability
Perks/Benefits
- N/A
Skills/Tech-stack
BTEQ | BigQuery | Cloud Composer | Cloud Storage | Data Ingestion | Data Modeling | Data Transformation | Dataflow | Informatica | Python | SQL | Teradata
Education
N/A
Roles
Related jobs
-
Airflow | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India12h ago
-
Senior Data Engineer- AWS INR 2000K-2500KAWS Glue | AWS Lambda | Amazon Redshift | Amazon Web Services | Apache AirflowSenior-level Full TimeBangalore North, India15h ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R17h ago
-
Senior-level Full TimeIN-KA-Bangalore17h ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R17h ago
-
Consultant - Cloud AI Developer INR 1400K-2500KAWS | Application Modernization | Application rationalization | Azure | Azure OpenAIMid-level Full TimeBangalore, Karnataka, India18h ago
-
AI Outcome Customer Engineer, FDE, Google Cloud INR 3799K-6000KAI Model Deployment | AI model | APIs | Access Management | Cloud infrastructureSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India18h ago
-
AI Customer Engineer, Developer AI, Google Cloud INR 2500K-5000KAI Agents | API Gateway | Audit Logging | Cloud platform | Distributed tracingConference participation | Travel opportunitiesSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Mid-level Full TimePune, Maharashtra, India19h ago
-
DTICI_SalesProductServices_DataEngineer_T9 INR 1500K-2500KAWS | Agile | Apache Spark | Azure | Azure DataMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Entry-level Full TimePune, Maharashtra, India19h ago
-
AI Full stack Engineer INR 2000K-5000KAPI Development | Agentic AI | BigQuery | Cloud SQL | Cloud platformSenior-level Full TimeIndia19h ago
-
Associate Process Manager INR 500K-1500KAzure SQL | Azure Synapse | BI Data modeling | Compliance | DAXMid-level Full TimeMumbai, Maharashtra, India19h ago
-
Agentic AI | Automation Anywhere | Azure OpenAI | Databases | Generative AIEntry-level Full Timebangalore, India20h ago
-
Lead Software Engineer - Data Platforms, REST APIs, SQL INR 3000K-5000KAWS | Agile | Authentication | Automated testing | CI/CDSenior-level Full TimeHyderabad, Telangana, India20h ago
-
QA Engineer INR 940K-1600KData Quality | Data Reconciliation | Data Validation | Data Warehousing | ETL TestingCareer development | Flexible work hours | Inclusive work culture | Insurance | Learning opportunitiesMid-level Full TimePune, India R21h ago
-
QA (ETL Test Engineer) INR 1000K-2000KAgile Scrum | Azure DevOps | Batch Processing | Data Modeling | Data ProcessingMid-level Full TimeNoida, Uttar Pradesh, India21h ago
-
Senior Analyst - AI/ML INR 2500K-5000KAWS | Artificial Intelligence | Automl | Azure | Cloud platformMentorship | TrainingSenior-level Full TimePune, Maharashtra, IND, 41101422h ago
-
Data Engineer INR 550K-850KAcceptance Testing | Batch Job Scheduling | Batch job | Data Lakes | Data MaintenanceEntry-level Full TimeNoida,Uttar Pradesh,India22h ago
-
Mid-level Full TimeBengaluru, Karnataka, India23h ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1000K-2000KAPIs | Airflow | Apache Beam | Auditability | Backwards CompatibilityCareer developmentMid-level Full TimeHyderabad, Telangana, India R23h ago
-
Mid-level Full TimeBengaluru, Karnataka, India23h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101323h ago
-
AI Data Scientist INR 1200K-3000KAgent systems | Agentic AI | Data Preprocessing | Data Quality | Diffusion ModelsMid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Software Engineer Data Analytics INR 1687K-2500KAPI Development | Agile | AppSheet | Apps Script | AutomationCollaborative global team environment | Flexible work modelMid-level Full TimeHyderabad, India1d ago