Associate Architect - Data (AWS + AtScale)
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Build governed data access using semantic layer
- Build real time pipelines with AWS Kinesis
- Create semantic models and metric definitions
- Design AWS data lake architecture
- Design AWS data warehouse
- Develop ETL using AWS Glue
- Develop Python and PySpark data processing jobs
- Develop metadata frameworks
- Enforce row and column level security
- Implement data lakes and lakehouse
- Implement governance and cataloging with AWS Lake Formation
- Integrate and migrate data with AWS DMS
- Integrate semantic layer with BI tools
- Manage operational databases with Amazon RDS
- Optimize Redshift schema and query performance
- Orchestrate pipelines with AWS Step Functions
- Process data with AWS Lambda
- Query data with Amazon Athena
- Run distributed workloads on Amazon EMR
- Write complex SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS CloudTrail | AWS DMS | AWS Glue | AWS IAM | AWS KMS | AWS Kinesis | AWS Lake Formation | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Aggregate awareness | Amazon Athena | Amazon Aurora | Amazon CloudWatch | Amazon DynamoDB | Amazon EMR | Amazon MWAA | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | AtScale | BI tools | CI/CD | Caching | Column-Level Security | Data Governance | Data Lake | Data Lakehouse | Data Modeling | Data mesh | Data virtualization | DocumentDB | ETL | Indexing | Lake Formation | MongoDB | MySQL | Partitioning | PostgreSQL | PySpark | Python | Query Optimization | Query Pushdown | Row Level Security | SQL | Schema Design | Secrets Manager | Semantic Modeling | Step Functions | Terraform
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeHyderabad, India7h ago
-
Senior-level Full TimeIN-KA-Bangalore8h ago
-
Senior Consultant INR 1900K-2600KAWS Lambda | Agile | Alerting | Amazon Web Services | Apache SparkGlobal team collaborationSenior-level Full TimeIN-KA-Bangalore8h ago
-
AI Engineer (Manager level) INR 1200K-1800KAI Search | Agile | Apache Spark | Azure AI | Azure AI SearchMid-level Full TimeHyderabad, India9h ago
-
ML Engineer (Data) INR 1500K-2000KAmazon SageMaker | Apache Spark | BERT | CI/CD | CachingCoaching | Hybrid work | Learning opportunities | Mentoring | Paid volunteer dayMid-level Full TimeBengaluru9h ago
-
Software Engineering INR 1500K-2000KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeMicrosoft cloud background check | On-call rotationMid-level Full TimeBengaluru, KA, IN10h ago
-
Software Engineer III - Python Developer + AWS + LLM / Gen AI INR 2000K-4000KAWS | Agile | Application Resiliency | Azure | CI/CDSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior Azure Data Engineer INR 2250K-3000KAzure Data | Azure Data Factory | Azure DevOps | Azure Functions | Azure SynapseSenior-level Full TimeThane, Maharashtra, India10h ago
-
AWS | Access Control | Alerting | Audit Logging | AzureSenior-level Full TimePune, MH, India11h ago
-
Security Engineer II - Java, AWS, AI/ML Security INR 1400K-2000KAI red teaming | API Security | AWS | Access Management | AzureContinuous learning cultureMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Data Scientist- Air Quality INR 1400K-1800KAccess Control | Airflow | Ansible | Azure | CI/CDHealth safety wellbeing support | Hybrid work model | Mentoring and team collaboration | Professional development supportMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior-level Full TimeIndia14h ago
-
Senior Storage Engineer INR 2000K-4000KAIX | AIX SDDPCM | Access Management | At Rest Encryption | AutosysFlexible working hours | Growth pathway | On site collaboration with global teams | On-call rotationSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India14h ago
-
Python Pyspark with GCP INR 2400K-4000KCloud platform | Google Cloud | Google Cloud Platform | PySpark | PythonEntry-level Full TimeBangalore, Karnataka, India14h ago
-
Remote Senior Data Engineer (ETL Data Modeling) INR 2040K-3500KAPIs | AWS EMR | AWS Glue | AWS Lake Formation | Amazon RedshiftDynamic working environment | Flexible schedule | Flexible working hours | International work environment | Low hierarchySenior-level Full TimeKarnataka, Bengaluru, India R14h ago
-
Senior-level Full TimePune, Maharashtra, India15h ago
-
Software Engineer III - Data Engineer INR 2000K-3500KAWS | Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India15h ago
-
Senior Data Engineer INR 2400K-3380KAzure | Azure Data | Azure Data Engineering | Azure Fabric | Cloud servicesSenior-level Full TimeGurgaon15h ago
-
Senior-level Full TimeIndia15h ago
-
Data Engineer - Global Research Modernization INR 1050K-1600KBeautifulSoup | Data Engineering | Data Governance | Data Quality | Data ValidationMid-level Full TimeMumbai, Maharashtra, India16h ago
-
AI/ML Engineer INR 2500K-4000KAI Foundry | AI Search | AWS Bedrock | App Service | Automated retrainingSenior-level Full Timetelengana, India16h ago
-
Artificial Intelligence | Data Governance | Data Quality | Data Science | LLMMid-level Full TimeMumbai, Maharashtra, India16h ago
-
DE&A - Core - Data Engineering - Informatica INR 3000K-4000KBI Publisher | Business Suite | Cause analysis | Data Engineering | Data PipelinesSenior-level Full TimeIndia16h ago
-
Senior ML Engineer INR 2500K-4725KAPI Design | Audio Processing | Azure Machine Learning | CI/CD | DVCCareer progression opportunities | Collaborative team environment | Health coverage | Personal development | Professional developmentSenior-level Full TimeTelangana, Hyderabad, India16h ago