Lead Architect
Tasks
- Apply data governance and lineage tracking
- Architect cloud data platforms on Azure
- Build end-to-end data pipelines
- Configure Snowflake virtual warehouses
- Deploy and manage Databricks notebooks and jobs
- Design Snowflake schemas
- Develop ETL/ELT workflows
- Enforce data security and access control
- Implement data quality frameworks
- Implement production ETL code in Python and PySpark
- Integrate NoSQL data into hybrid solutions
- Integrate search and indexing for unstructured data
- Manage metadata and catalogs
- Optimize Spark workloads and partitioning
- Set up CI CD pipelines and automated deployments
- Tune Snowflake query performance
- Write SQL transformations and optimization
Perks/Benefits
- 401k plan
- Dental insurance
- Disability insurance
- Health insurance
- Life insurance
- PTO
- Paid Holidays
- Parental leave
- Vision insurance
Skills/Tech-stack
API | Agile | Azure Cognitive | Azure Cognitive Search | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Synapse | Azure Synapse Analytics | CI/CD | Cognitive Search | Cosmos DB | Data Factory | ELT | ETL | Elasticsearch | Event Hubs | Git | Hadoop | Hive | JSON | Jenkins | Kafka | MongoDB | Parquet | PySpark | Python | SFTP | SQL | Snowflake | Spark | Synapse Analytics | XML
Education
N/A
Roles
Architect | Data Engineer | Engineer | Lead | Lead Architect
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R7h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States8h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | Broadcast joins | CI/CD | CachingMid-level Full TimeArlington, VA8h ago
-
Google Cloud Platform (GCP) Data Engineer USD 100K-203KApache Beam | BigQuery | CI/CD | Cloud Storage | Cloud platformSecurity clearance providedMid-level Full TimeArlington, VA8h ago
-
Lead Data Analyst, Product Analytics USD 150K-180KA/B | A/B Testing | Analytics engineering | B testing | BigQuerySenior-level Full TimeRemote, US R9h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas11h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R11h ago
-
Sr. Data Engineer (HYBRID) USD 145K-160KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBComplimentary club membership | Hybrid work schedule | Personal training | Pilates | Shop discountsSenior-level Full TimeNew York, NY, United States R12h ago
-
Staff Data Engineer - Data Engineering USD 207K-275KAccess Control | Apache Fluss | Apache Hudi | Apache Iceberg | Apache Paimon401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTOSenior-level Full TimeLivingston, NJ / New York, NY …12h ago
-
Cheminformatics | Cloud Computing | Data Analysis | Data Visualization | Deep learningSenior-level Full TimeRedwood City, California, United States12h ago
-
AI Developer USD 99K-198KAWS | Agentic AI | Azure | CI/CD | Data LakesHybrid work schedule | Leadership development | Professional developmentMid-level Full TimeWashington, DC12h ago
-
Lead Data Modeler USD 130K-165KAWS Databricks | Azure DevOps | Business Data Analysis | Business data | Conceptual data modelingSenior-level Full TimeNew York, NY, United States13h ago
-
Lead Architect, GenAI Platform & Agentic AI USD 170K-220KAPI Gateway | API driven LLM | API-driven | AWS | AWS CDK401k with profit sharing | Disability coverage | Life insurance | Medical, prescription, dental and vision coverage | Paid HolidaysSenior-level Full TimeWoodbridge, NJ, United States13h ago
-
Senior-level Full TimeOrlando, FL, United States13h ago
-
AI Requirements Engineer USD 120K-145KAWS | Acceptance criteria | Agile | Analytics | Artificial IntelligenceMid-level Full TimeArlington, VA, United States13h ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsCompany-matched 401k | Flexible schedule | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeUnited States R14h ago
-
AWS | Azure | Cloud Run | Django | Docker401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeSan Jose, CA, United States14h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KBusiness Intelligence | Microstrategy | Python | R | SQL401k match | Dental insurance | Disability insurance | Firm paid holidays | Health insuranceEntry-level Full TimeWashington, DC, United States14h ago
-
Algorithms | Concurrency | Data Structures | ESQL | ElasticsearchFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeUnited States R14h ago
-
Artificial Intelligence | C plus plus | CUDA | Camera Calibration | Computer VisionVisa sponsorship not availableMid-level Full TimeKenner, LA, United States16h ago
-
Solutions Engineer USD 95K-130KAgile | Audit controls | Bug Fixing | Dashboards | Data LineageOnsite positionMid-level Full TimeNew Albany, OH, United States17h ago
-
Senior-level Full TimeSouthfield, Michigan, USA, 4807617h ago
-
Reindeer- Software Engineer (Infrastructure) USD 180K-250KAPI Integration | AWS | Authentication | Authorization | AzureSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL17h ago
-
Reindeer- AI Solutions Engineer (IL) USD 80K-170KApplication Integration | Cloud Computing | Communication | Compliance | Data AnalysisSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL18h ago