DE-RCE-AIProject-PythonAI-Manager-GDSN02
Tasks
- Build and optimize distributed data processing pipelines
- Design SQL transformations
- Develop reusable Python data processing components
- Drive Agile delivery estimation risk management dependency tracking continuous improvement
- Drive data ingestion transformation quality lineage reconciliation monitoring
- Ensure security privacy coding quality version control release management standards
- Lead end to end data engineering solution delivery
- Participate in client discussions solution design proposals technical presentations
- Perform code and design reviews and mentor data engineers
- Translate requirements into technical solutions
- Tune SQL query performance
- Use Impala for interactive analytics and troubleshooting
Perks/Benefits
Skills/Tech-stack
AWS | Apache Airflow | Azure | Data Lineage | Data Modeling | Data Quality | Exception Handling | File Formats | Flask | GCP | Hadoop | Impala | JSON | Logging | Oozie | Partitioning | PySpark | Python | Query Optimization | REST API | SQL | Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Software Development Engineer INR 2500K-4000KAgile | Artificial Intelligence | CI/CD | Data Engineering | Data LakeSenior-level Full TimeIndia8h ago
-
Qualtrics/Tableau - Analytics - Associate INR 4000K-4000KAgile | CI/CD | Dashboard governance | Data Modeling | Data pipelineExecutive-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Engineer -Snowflake Development INR 1000K-1500KAWS | Acceptance Testing | Agile | Azure | CSVFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeChennai, India9h ago
-
AI/ML Architect INR 2500K-5000KAmazon Web Services | Anomaly Detection | Azure | Cloud platform | Data IngestionSenior-level Full TimeChennai, TN, India11h ago
-
Data Engineer INR 1500K-2500KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN11h ago
-
Member of Technical Staff 4 INR 3242K-4580KAWS | Amazon Redshift | Azure Synapse | Azure Synapse Analytics | Backend architectureFlexible working arrangement | In-office 3 days per weekSenior-level Full TimeHyderabad, India12h ago
-
Analytics Senior Manager - Risk & Controls INR 2000K-3200KA/B | A/B Testing | B testing | Data Visualization | Financial crimeSenior-level Full TimeHyderabad, India12h ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Data ProcessingSenior-level Full TimeBangalore, India13h ago
-
Senior Manager, Analytics & Automation INR 3000K-4132KAgile | Alteryx | Data Governance | Data Preparation | Data TransformationAnnual leave | Flexible benefits | Life insurance | Medical insurance | Parental/maternity leaveSenior-level Full TimeChennai, IN14h ago
-
Dashboard & Analytics Lead INR 2475K-3900KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeNew Delhi, IN14h ago
-
A/B | A/B Testing | API | B testing | DashboardingAnnual bonus scheme | Collaborative work environment | Flexible work environment and schedule | Flexible working hours | Group medical insuranceMid-level Full TimeIndia R14h ago
-
Senior-level Full TimeIN-Pune14h ago
-
VP - Applied AI ML Lead INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Models | Language ProcessingSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
AI Agents | APIs | AWS | Application Modernization | AutomationCertification support | Employee Wellness Initiatives | Flexible work arrangements | Health insurance | Learning and developmentSenior-level Full TimeIndia15h ago
-
API Development | Access Control | CI/CD | MySQL | Next.jsSenior-level Full TimePAN India, KA, IN19h ago
-
Testing Engineering Specialist Advisor INR 2475K-3380K.NET | AI Search | AWS | Application Insights | AzureSenior-level Full TimeNoida, UP, IN R19h ago
-
AI Solutions Engineer - Mergers & Acquisitions PLN 14K-26KAPI Gateway | AWS ECS | AWS Lambda | Authentication | AuthorizationMid-level Full TimePune DIA, India19h ago
-
Risk Analytics - Product Analyst - Senior INR 3000K-4064KAcceptance Testing | Artificial Intelligence | Audit compliance | Automation | Backlog prioritizationSenior-level Full TimeBengaluru, KA, IN, 56001619h ago
-
Data Engineer III INR 2800K-4000KAWS | AWS CDK | AWS Glue | AWS Glue Workflows | AWS KinesisAccident insurance | Casual leave | Compassionate leave | Employee assistance program | Flexible working arrangementSenior-level Full TimeIndia-Chennai (Ascendas Tech park)19h ago
-
Systems Integration Specialist Advisor_Storage Cloud INR 800K-1099KAWS | Access Control | Automation | Block Storage | CI/CDMid-level Full TimeBangalore, KA, IN R19h ago
-
EYP - DnA - Assistant Manager INR 1500K-2000KAlteryx | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataClient site travel | Coaching and mentoring | Continuous learning | Inclusive cultureMid-level Full TimeBengaluru, KA, IN, 56001619h ago
-
Entry-level Full TimeBangalore, KA, IN19h ago
-
Mid-level Full TimeBengaluru, BDC6F, India19h ago
-
Packaged/SaaS Application Engineer INR 1000K-2100KAI Search | AI Studio | API Development | API Management | AgileMid-level Full TimeHyderabad, HDC4A, India19h ago
-
Data Engineer INR 100K-1000KData Governance | Data Modeling | Data Pipelines | Data Quality | Data TransformationMid-level Full TimeGurugram, Haryana, India19h ago