Principal Architect - Databricks
USD 180K-250K (estimate) Senior-level Full Time
Tasks
- Build IoT ingestion and stream processing pipelines
- Build data lakehouse and EDW systems
- Design data architecture
- Extract and transform unstructured data into datasets
- Implement Data Governance and Master data management
- Implement information lifecycle management
- Model structured and unstructured data
Perks/Benefits
Skills/Tech-stack
AWS | AWS IoT | AWS IoT Core | AWS IoT Device Defender | AWS IoT Device Management | AWS Lambda | Amazon DynamoDB | Amazon EMR | Amazon Kinesis | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DB | Azure Functions | Azure IoT | Azure IoT Device SDK | Azure IoT Hub | Azure IoT Hub Device Provisioning Services | Azure Stream | Azure Stream Analytics | Containerization | Cosmos DB | Databricks | Delta Lake | Device Management | Device Twins | IoT Core | IoT Device Management | IoT Hub | Lakehouse | Provisioning Services | Serverless | Stream Analytics
Education
N/A
Roles
Architect | Data Architect | Principal | Principal Data Architect
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R5h ago
-
Principal Data Engineer - Remote USD 112K-193KAWS Glue | AWS RDS | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimePrimary location: Orlando, FL R1d ago
-
Data Platform Architect USD 100K-150KAlation | Amazon Redshift | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeUnited States - Remote R1d ago
-
Enterprise Data Architect USD 116K-185KAWS | Azure | Cloud Computing | Data Governance | Data ModelingRelocation allowed within approved states | Remote work within approved statesSenior-level Full TimeWFH State of Oklahoma, United States R1d ago
-
Cloud Solutions Architect (Remote) USD 110K-148KAPI Integration | AWS | AWS Fargate | AWS Lambda | Amazon Aurora401k matching | Company holidays | Dental insurance | Health insurance | Learning and development programsSenior-level Full TimeSupport Center - Akron, OH, United … R1d ago
-
Apache Spark | Cloud Computing | Data Engineering | Data Governance | Data analyticsCompetitive benefits package | Remote workSenior-level Full TimeUnited States R2d ago
-
Principal Data Engineer IS - Remote USD 104K-272KAPI | AWS | Agile | Azure | Azure DevOps401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeRedmond, WA, United States R2d ago
-
Principal Architect USD 170K-277KAWS | Agile | Asynchronous Workflows | Authentication & Authorization | AzureSenior-level Contract Full TimeRemote, United States R2d ago
-
AWS | Azure | Benchmarking | Containerization | Direct Preference OptimizationCustomer facing technical work | Remote workSenior-level Full TimeSan Mateo, California, United States R2d ago
-
Principal Java Data Engineer USD 144K-160KADLS Gen2 | AWS | Alerting | Apache Hudi | Apache SparkAllyship and inclusion communities | Caregiver leave | Continuous development support program | Employee assistance program | Employee recognitionSenior-level Full TimeRemote, USA R2d ago
-
Senior / Principal Infrastructure Engineer - ML Platform USD 278K-345KAWS | CI/CD | Cloud infrastructure | Cloud platform | Cluster managementEquity compensation | Onsite schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R2d ago
-
Senior / Principal Data Scientist - Discovery USD 307K-373KApache Airflow | Apache Spark | Causal Inference | Deep learning | ExperimentationEqual employment opportunities | Equity compensation | Health benefits | Onsite collaboration daysSenior-level Full TimeSan Mateo, CA, United States R2d ago
-
Information Management Data Architect USD 126K-188KAI Agent | AI Agent framework | Agent Framework | Apache Iceberg | Apache SparkBonus plan | Health insurance | Retirement planSenior-level Full TimeRemote, Ohio, United States of America R2d ago
-
Enterprise AI Architect USD 137K-220KAPIs | Agile | Amazon Web Services | Azure | CI/CDDental insurance | Employer-funded retirement | Free tuition program | Medical insurance | Mental health resourcesSenior-level Full TimeRemote (United States), United States R2d ago
-
Senior-level Full TimeMansfield, MA (Remote) R2d ago
-
Senior Architect - Data Architecture & Engineering USD 136K-204KARM Templates | Agile | Azure | Azure DevOps | Azure FunctionsFlexible work location | Virtual workSenior-level Full TimeRemote - US R3d ago
-
Senior Principal Machine Learning Engineer USD 250K-280KA/B | A/B Testing | Airflow | Apache Spark | Artificial Intelligence401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeRemote, United States R3d ago
-
Principal AI Data Analyst- Remote USD 112K-193KAWS | Automation | Azure | CI/CD | Data Lake401k contribution | Comprehensive benefits | Equity stock purchase | Incentive and recognition programs | Remote workSenior-level Full TimePrimary location: Eden Prairie, MN R3d ago
-
Enterprise Data Architect USD 100K-150KAmazon Redshift | Apache Hudi | Apache Iceberg | Batch Processing | BigQuerySenior-level Full TimeUnited States - Remote R3d ago
-
Data Platform Architect USD 100K-150KAccess Management | Amazon Redshift | Apache Flink | Apache Hudi | Apache KafkaFull-time benefits | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
Data Platform Architect USD 100K-150KAccess Control | Access Management | Alation | Amazon Redshift | Apache FlinkFull time W2 employment benefits | Long-term career growth | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
Data Platform Architect USD 100K-150KAWS | Access Management | Amazon Redshift | Apache Flink | Apache HudiSenior-level Full TimeUnited States - Remote R3d ago
-
Data Platform Architect USD 100K-150KAWS | Access Management | Alation | Amazon Redshift | Apache HudiHealth benefits | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiSenior-level Full TimeUnited States - Remote R3d ago
-
Access Control | Azure Databricks | CDC | Clustering | Data CatalogSenior-level Full TimeUnited States - Remote R3d ago