Lead Architect
Tasks
- Apply data governance and lineage tracking
- Architect cloud data platforms on Azure
- Build end-to-end data pipelines
- Configure Snowflake virtual warehouses
- Deploy and manage Databricks notebooks and jobs
- Design Snowflake schemas
- Develop ETL/ELT workflows
- Enforce data security and access control
- Implement data quality frameworks
- Implement production ETL code in Python and PySpark
- Integrate NoSQL data into hybrid solutions
- Integrate search and indexing for unstructured data
- Manage metadata and catalogs
- Optimize Spark workloads and partitioning
- Set up CI CD pipelines and automated deployments
- Tune Snowflake query performance
- Write SQL transformations and optimization
Perks/Benefits
- 401k plan
- Dental insurance
- Disability insurance
- Health insurance
- Life insurance
- PTO
- Paid Holidays
- Parental leave
- Vision insurance
Skills/Tech-stack
API | Agile | Azure Cognitive | Azure Cognitive Search | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Synapse | Azure Synapse Analytics | CI/CD | Cognitive Search | Cosmos DB | Data Factory | ELT | ETL | Elasticsearch | Event Hubs | Git | Hadoop | Hive | JSON | Jenkins | Kafka | MongoDB | Parquet | PySpark | Python | SFTP | SQL | Snowflake | Spark | Synapse Analytics | XML
Education
N/A
Roles
Architect | Data Engineer | Engineer | Lead | Lead Architect
Related jobs
-
Senior Machine Learning Engineer USD 155K-200KC++ | Data Engineering | Data Ingestion | Data Retrieval | Data Storage401k employer contributions | All-hands meetings | Healthcare coverage | Team Member Appreciation AwardsSenior-level Full TimeFremont, CA6h ago
-
Senior Embedded Software Engineer - SATCOM USD 139K-193KBootloader | C# | C++ | CI/CD | Continuous integrationDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeWestminster, CO8h ago
-
Senior Embedded Software Engineer - Spacecraft USD 160K-200KAttitude Dynamics | C plus plus | C# | Code profiling | Communication SystemsDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeWestminster, CO8h ago
-
Embedded Software Engineer II - SATCOM USD 125K-175KBoard Bring-up | Bootloader | Bring-up | CI/CD | Configuration ManagementCompany stock options | Dental insurance | Disability insurance | FSA | HSAEntry-level Full TimeWestminster, CO8h ago
-
Embedded Software Engineer II USD 105K-145KBoard Bring-up | Bring-up | C# | C++ | CIDental insurance | Disability insurance | FSA | HSA | Health insuranceMid-level Full TimeAustin, TX8h ago
-
Embedded Software Engineer II USD 105K-145KBootloader | Bring-up | C# | C++ | CI/CDDental insurance | Disability insurance | FSA | HSA | Health insuranceMid-level Full TimeWestminster, CO8h ago
-
Embedded Software Engineer II USD 105K-145KBootloader | C# | C++ | CI/CD | Code reviewDental insurance | Disability insurance | FSA | HSA | Health insuranceMid-level Full TimeEl Segundo, CA8h ago
-
Software Engineer, Data Flywheel Platform USD 283K-335KAirflow | Dagster | Data orchestration | Databricks | Distributed SystemsSenior-level Full TimeSunnyvale13h ago
-
Artificial Intelligence | C# | C++ | CAD | Design of ExperimentsHealth insurance | Paid time off | Recovery BenefitsSenior-level Full TimeCosta Mesa, California, United States21h ago
-
Senior Software Engineer, Robotics Platform USD 175K-269KC# | C++ | CUDA | DDS | Embedded SystemsOn-site workSenior-level Full TimeSan Francisco1d ago
-
Mechatronic/Robotics Engineer or Systems Integration Engineer - Camera and Sensor Calibration USD 139K-211KAutomation systems | Bash | C++ | Camera Calibration | Control SystemsCollaborative team environment | Hands-on engineering role | On site work full timeMid-level Full TimeMountain View, CA1d ago
-
Senior-level Full TimeMountain View, CA1d ago
-
Mid-level Full TimeRedwood City, CA1d ago
-
Mid-level Full Time200 Varick St #802, New York, …1d ago
-
APIs | Code Development | Evaluation | GraphQL | HubSpot401k matching | Childcare reimbursement | Dental insurance | Health insurance | Internet reimbursementEntry-level Full TimeSeattle Office R1d ago
-
AI workflows | API connectors | APIs | CRM automation | Evaluation401K company matching | Childcare reimbursements | Commuter reimbursements | Generous parental leave policy | Medical/Dental/Vision insuranceSenior-level Full TimeSan Francisco Office R1d ago
-
APIs | CRM automation | Code Automation | Evaluation | GraphQL401k match | Childcare reimbursement | Commuter reimbursement | Medical, dental, and vision insurance | Parental leaveEntry-level Full TimeNew York Office R1d ago
-
AC DC Sizing | AC/DC | Arc Flash | Artificial Intelligence | AutomationMultiple project extensions | Paid on time | Remote work optionSenior-level Full TimeJuno Beach, FL R1d ago
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R1d ago
-
API Integration | AWS Bedrock | Auditing | Authentication | AuthorizationMentoring | MentorshipMid-level Full TimeMenlo Park, CA, United States1d ago
-
Senior Software Engineer (Java Full Stack) - Hybrid USD 138K-183KAgile | C plus plus | Concurrency | Data Structures | Embedded SystemsHybrid work | Remote work possibleSenior-level ContractBoston, United States1d ago
-
AI Solution Architect USD 38KArtificial Intelligence | Deep learning | Language Processing | MLOps | Machine LearningSenior-level Full TimeMorrisville, North Carolina, États-Unis d’Amérique1d ago
-
Data Architect USD 145K-180KAWS Glue | AWS Lambda | AWS Redshift | AWS S3 | Azure DevOpsDental insurance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountSenior-level Full TimeHouston, Texas | Tulsa, Oklahoma | …1d ago
-
Lead Palantir AI and Data Science Engineer II USD 159K-265KAI workflows | Analytics | Cloud Computing | Dashboards | Data GovernanceProfessional development | Travel opportunitiesSenior-level Full TimeRosslyn, Virginia, United States1d ago
-
Analytics and Insights Engineer III USD 131K-218KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeRichmond, Virginia, United States1d ago