Data Engineering Python and Pyspark - Assistant Vice President
RAMANUJAN IT CITY SEZ TARAMANI CHENNAI, India
INR 1500K-5800K (estimate) Executive-level Full Time
Tasks
- Analyze large datasets for trends anomalies and patterns
- Apply supervised and unsupervised learning concepts
- Automate data ingestion aggregation and ETL
- Build data pipelines (batch and real-time)
- Build deploy and maintain data products
- Develop ETL processes
- Extract, transform and load data
- Implement data privacy security and compliance
- Maintain optimize data infrastructure
- Monitor control development phases and implementation
- Monitor data system performance
- Perform data quality control
- Perform feature engineering and data transformations
- Prepare warehouse data for analytics stakeholders
Perks/Benefits
- N/A
Skills/Tech-stack
Ab Initio | Airflow | Anomaly Detection | Bash | Classification | Clustering | Data Aggregation | Data Ingestion | Data Lakehouse | Data Warehouse | ETL | Feature Engineering | HDFS | Hive | Iceberg | Impala | Machine Learning | PySpark | Python | Regression | S3 | SQL | Starburst | Talend | Unix Shell
Education
Related jobs
-
SSE_Analytics Enablement INR 2250K-5000KAI/ML | Alteryx | Analytics engineering | Architecture Review | AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India2h ago
-
SSE_Analytics Enablement INR 2250K-5000KAlteryx | Architecture Review | Artificial Intelligence | CI/CD | Code AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India2h ago
-
Forward Deployed Engineer INR 4500K-7000KAI | APIs | Agentic AI | Developer tools | Enterprise SoftwareHigh-ownership environment | Onsite customer engagement | R and D Collaboration | Structured Product FeedbackSenior-level Full TimeGurugram, Haryana, IN8h ago
-
Entry-level Full TimeBengaluru, India8h ago
-
GCP Data Engineer / Consultant Specialist INR 1500K-2000KAirflow | Alerting | Apache Beam | Automation | BigQueryFlexible working | Inclusive workplace | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R8h ago
-
Senior AI Testing Engineer (Generative AI) INR 2000K-3300KAI Agents | API Testing | AWS | Azure | CI/CDSenior-level Full TimeBangalore North, India9h ago
-
Senior-level Full TimeIN-KA-Bangalore9h ago
-
Senior-level Full TimeIN-KA-Bangalore9h ago
-
Senior-level Full TimeIN-KA-Bangalore9h ago
-
Senior-level Full TimeIN-KA-Bangalore9h ago
-
Senior-level Full TimeIN-KA-Bangalore9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
Data Science and Tech Lead AMEA INR 2000K-3500KAWS | Agile | Amazon Bedrock | Amazon SageMaker | CI PipelinesSenior-level Full TimePune, ASIA, India10h ago
-
Mid-level Full TimeBangalore, Karnataka, India11h ago
-
Mid-level Full TimeBangalore, Karnataka, India11h ago
-
Mid-level Full TimeBangalore, Karnataka, India11h ago
-
Mid-level Full TimeBangalore, Karnataka, India11h ago
-
Assistant Manager- AI Engineer INR 1500K-2800KAmazon Web Services | Anthropic Claude | Autogen | Azure | Cloud platformMid-level Full TimeBangalore, Karnataka, India11h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India11h ago
-
Senior Software Engineer, AI/ML, AI Garage INR 2500K-4800KApache Beam | BigQuery | Cause analysis | Data Processing | DataflowSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Data Engineer, Play Data Science and Analytics INR 1500K-2500KAI | Automation | C plus plus | Data Infrastructure | Data ModelingMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Data Engineer, YouTube INR 800K-1400KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ArchitectureMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Practice Customer Engineer, GenAI, Public Sector, Google Cloud INR 2000K-3300KAPIs | Agentic AI | Audit Logging | Cloud Networking | Cloud infrastructureSenior-level Full TimeGurgaon, Haryana, India; Bengaluru, Karnataka, India11h ago
-
Practice Customer Engineer, GenAI, Manufacturing, Google Cloud INR 2000K-3300KAI Agents | Audit Logging | Cloud Architecture | Cloud Computing | Distributed tracingConference participation | Professional development | Technical stakeholder exposure | Travel opportunitiesSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 1800K-3000KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesMid-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India11h ago