Principal Fullstack Data Engineer
Dallas, Texas, United States
USD 135K-189K (estimate) Senior-level Full Time
Tasks
- Build REST APIs with Node.js
- Build data pipelines using Python and Kafka
- Define data governance policies
- Develop Iceberg data lakehouse
- Develop React reporting and analytics portal
- Document data architecture and workflows
- Implement real time data ingestion and transformation
- Integrate diverse data sources using Kafka
- Lead data architecture design
- Maintain PostgreSQL schemas and queries
- Monitor systems with Prometheus and Grafana
- Optimize pipeline performance
- Provide technical leadership and mentorship
- Serve data in JSON and CSV
- Use query federation with Starburst Trino
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Apache Iceberg | Apache Kafka | Batch Processing | CI/CD | CSV | Data Governance | Data Modeling | Data Privacy | Data Quality | Docker | GitHub Actions | Grafana | JSON | Kubernetes | Lakekeeper | Lambda/Kappa | Minio | Node.js | Object storage | PostgreSQL | PostgreSQL optimization | Prometheus | PyArrow | PyIceberg | Pydantic | Python | REST APIs | React.js | Real Time | Real-time Processing | Schema Design | Snowflake Schema | Star Schema | Starburst | Time processing | Trino
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Staff Machine Learning Engineer USD 188K-221KAWS | Amazon Redshift | Amazon SageMaker | Apache Airflow | Apache FlinkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R3h ago
-
Staff Software Engineer, Data & AI USD 183K-214KAWS | Airflow | Analytics | Artificial Intelligence | BI AnalyticsSenior-level Full TimeCA - San Francisco; WA - …4h ago
-
Infrastructure Data Engineer USD 140K-180KApache Iceberg | Cloud Computing | Containers | Data Governance | Data LineageMid-level Full TimeBoston, MA8h ago
-
Governance Data Engineer USD 140K-180KAccess Control | Access Management | Analytics engineering | Data Access Management | Data ArchitectureSenior-level Full TimeBoston, MA9h ago
-
Reinsurance Data Engineer USD 150K-220KAWS Glue | Amazon Redshift | Amazon S3 | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeBoston, MA9h ago
-
Staff Marketing Data Scientist, Machine Learning USD 153K-240KA/B | A/B Testing | B testing | Experimentation | Feature StoreSenior-level Full TimeCA - San Francisco9h ago
-
Sr. Staff Embedded AI Engineer USD 140K-170KBare Metal | C plus plus | C# | CMSIS NN | Code generationEmployee resource groups | Flexible work environment | Remote Work Hybrid ScheduleSenior-level Full TimeColumbia, MARYLAND, United States R10h ago
-
Access Control | Amazon Web Services | Apache Airflow | C++ | CI/CD401k match | Employee wellness programs | Family leave | Health care benefits | Parental leaveSenior-level Full TimeUnited States10h ago
-
Data Engineer USD 100K-113KAmazon S3 | DBT | Dataiku | Dremio | Iceberg401k match | Career growth | Generous paid time off | Global inclusive culture | Medical, dental, and vision insuranceSenior-level Full TimeAustin10h ago
-
Senior Software Engineer, Data Platform USD 187K-259KAccess Control | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache Flink401k match | Backup care | Bonus | Commuter benefit | Dental insuranceSenior-level Full TimeSan Francisco, CA, USA11h ago
-
Staff Embedded System Engineer USD 130K-181K8D methodology | A3 | Bus Traces | Bus analyzer | C++401k matching | Employee assistance program | Life, accident, and disability insurance | Medical/Dental/Vision insurance | Paid sick leaveSenior-level Full TimeIrvine, CA, United States11h ago
-
C++ | Data Processing | Data Processing Pipelines | Importance sampling | Machine LearningBonus plan | Equity incentive plan | Health and welfare benefitsSenior-level Full TimeMountain View, CA, USA; San Francisco, …11h ago
-
Senior Staff ML Engineer, Search & Recommendation USD 266K-372KEvaluation | Go | Language Models | Large Language Models | Machine Learning401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Healthcare benefitsSenior-level Full TimeRemote - United States R11h ago
-
Senior Data Engineer USD 115K-145KApache Airflow | Apache Flink | Apache Spark | Cloud Computing | Data Modelling401k | Dental insurance | Discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States R12h ago
-
Anomaly Detection | C++ | Cause analysis | Data Processing | Deep learningBonus | Discretionary annual bonus | Equity incentive plan | Health benefitsSenior-level Full TimeMountain View, CA, USA12h ago
-
AI Search | Amazon SageMaker | Application development | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
Senior Data Engineer (St. Louis) USD 111K-139KANSI SQL | API | Amazon Redshift | Apigee | Azure401k matching | Bereavement | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeRemote - Nationwide, United States R13h ago
-
AI Automation | Apache Airflow | Apache Kafka | Apache Spark | Cloud Computing401k match | Child care benefits | Family building benefits | Lyft Pink membership | Lyft creditsSenior-level Full TimeSeattle, WA R13h ago
-
AI | Apache Airflow | Apache Kafka | Apache Spark | Automation401k match | Child care benefits | Commuter benefits | Dental insurance | Family building benefitsSenior-level Full TimeSan Francisco, CA R13h ago
-
Machine Learning Engineer I USD 128K-192KAI Agents | Deep learning | Generative AI | Language Processing | Machine LearningMid-level Full TimePalo Alto, CA13h ago
-
IT AI&S Senior Data Engineer USD 150K-196KAWS | Apache Spark | Azure | Data Architecture | Data GovernanceSenior-level Full TimeDallas, TX, United States14h ago
-
Applied AI Engineer USD 105K-150KA/B | A/B Testing | AWS | Agile | B testingCollaborative work environment | Documentation and long term maintainability focus | Onsite work 4 days per weekMid-level Full TimeDallas, TX, United States14h ago
-
AI Engineer I USD 104K-156KAgentic AI | Apache Spark | Async Processing | Async Processing Pipelines | Backend systemsMid-level Full TimeBoston, MA14h ago
-
Applied AI Engineer USD 105K-150KA/B | A/B Testing | AWS | Agile | AzureEqual opportunity employment | Onsite work 4 days per weekMid-level Full TimeNew York, NY, United States14h ago
-
Lead Data Analyst – World Cup Reporting Initiative USD 126K-267KAgile | Data Lakehouse | Data Pipelines | Databricks | ETLSenior-level ContractBeaverton, OR, US15h ago