Engineer - PySpark/SQL
Pune, Gera Commerzone SEZ, India
INR 1500K-2500K (estimate) Entry-level Full Time
Tasks
- Build data lake systems
- Build data pipelines
- Build reusable components
- Collaborate with stakeholders to gather requirements
- Deploy machine learning models with data scientists
- Design data warehouse solutions
- Develop ELT pipelines with DBT
- Develop data transformation logic
- Develop processing and analysis algorithms
- Ensure data governance and lineage
- Implement scalable data storage solutions
- Ingest data into Snowflake
- Orchestrate ETL workflows
- Translate user stories into ETL components
- Write PL SQL programs
- Write advanced SQL
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Cloud | AWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | Alation | Amazon Athena | Amazon S3 | Apache Airflow | Apache Spark | CSV | DBT | Data Governance | Data Ingestion | Data Lineage | Data Marts | Data Transformation | Data Warehousing | DataFrame | ELT | Iceberg | Immutta | JSON | Lake Formation | NoSQL | PL/SQL | Parquet | PySpark | RDD | SQL | Snowflake | Snowflake Tasks | SparkSQL
Education
N/A
Roles
Related jobs
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R1d ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE) R1d ago
-
Junior BI Developer/Data Engineer - India Home Base INR 300K-300KBig Data | Data Modeling | Data Pipelines | ETL | JavaFlexible remote work | Professional development opportunitiesEntry-level Full TimeBangalore, India1d ago
-
Access Control | Anomaly Detection | Audit Logging | CI/CD | ClassificationRemote working modelSenior-level Full TimeIndia1d ago
-
Databricks Data Engineer - Contract-to-Hire INR 1500K-3000KAWS | Apache Spark | Azure | Data Reconciliation | Data ValidationMedical insurance | Paid time off | Professional development trainingSenior-level Full TimePune, MH, India1d ago
-
Senior Databricks Data Engineer INR 1500K-3500KAWS | CI/CD | Databricks | Delta Lake | LakehouseMedical insurance | Paid time off | Performance incentives | Professional development trainingSenior-level Full TimePune, MH, India1d ago
-
Lead AI Specialist (Finance Operations) INR 3264K-5449KAccess Control | Agent Orchestration | Audit Logging | BigQuery | Change ManagementCollaborative culture | Growth opportunities | Work-life balance programsSenior-level Full TimeMumbai, MH, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India R1d ago
-
Applied AI ML Associate INR 1400K-2400KAutomation | Data Quality | Data analytics | Data pipeline | DatabaseMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Lead Assistant Manager INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Storage | Cloud platformSenior-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Data Engineer Consultant Senior INR 3000K-4000KAgile | Alerting | Auditability | Automated testing | AzureBike to work | Career mentorship | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R1d ago
-
Data Engineer Consultant Principal INR 3000K-4000KAccess Control | Agile | Audit and compliance | Auditability | Automated testingBike to work | Career progression mentorship | Educational assistance | Employee assistance programme | Employee discount schemeSenior-level Full TimeBengaluru, KA, India R1d ago
-
AWS | Agile | Apache Spark | Azure | CI/CDEducation and learning support | Generous time off | Professional growth | Remote work | Wellness and lifestyle resourcesSenior-level Full TimeIndia R1d ago
-
Senior ML Operations Engineer INR 2500K-5000KAI Governance | AWS | Automated retraining | Azure | Azure MLSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
AI Engineer INR 3000K-5000KAI Services | AWS SageMaker | Azure AI | Azure AI Services | Azure DevOpsMid-level Full TimeIndia1d ago
-
Software Development Specialist INR 940K-940KAmazon CloudWatch | Amazon DynamoDB | Amazon S3 | Amazon Web Services | Azure DevOpsMid-level Full TimeBangalore, KA, IN R1d ago
-
VP - Sr Lead Data Engineer (Snowflake) INR 4000K-6000KAgile | Data Governance | Data Modeling | Data Pipelines | Data QualityExecutive-level Full TimeMumbai, Maharashtra, India1d ago
-
Group Data Engineer I INR 1500K-2600KAWS | AWS CloudFormation | Agile | Apache Airflow | Apache SparkSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
L2 Engineer - Coach INR 2000K-5000KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon DynamoDBSenior-level Full TimePune1d ago
-
Data Engineer 2 INR 1986K-2500KData Architecture | Data Engineering | Data Pipelines | Data Quality | Data TransformationHybrid workMid-level Full TimeIN-Bangalore (3811)1d ago
-
Senior Manager INR 1500K-2800KAWS Glue | AWS Secrets | AWS Secrets Manager | Adaptive Query | Adaptive query executionHybrid work modeSenior-level Full TimePune, Maharashtra, India R1d ago
-
Senior Consultant - Data Engineering- INR 2000K-3500KApache Kafka | Apache Spark | Cloud Computing | Data Modeling | Data PipelinesSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Senior Data Engineer INR 3000K-4200KAPI Management | AWS | Application Architecture | Azure API | Azure API ManagementSenior-level Full TimeIndia1d ago
-
AI Agents | Alation | Autogen | C Sharp | CI/CDHybrid work | Inclusive workplace | Mentorship | Relocation assistance | Travel up to 10 percentSenior-level Full TimeIndia1d ago