Spice Data (YC S19) Is Hiring a Founding Senior/Staff Software Engineer

Join our small and nimble engineering team! We’re looking for an experienced engineer who enjoys working on a variety of different projects and large(ish) data pipelines (100M+ data points collected every month). Work in our downtown San Francisco office Tue-Thu Provide mentorship to your teammates via code and architecture review Help to improve, maintain and expand our end to end data pipeline Create and manage data collection/crawling scripts that utilize everything from basic HTTP requests to browser and mobile app automation (deep experience in this area is a huge plus) Build and maintain automation/scheduling tooling to ensure data is collected on a timely and consistent basis (we’re currently using self hosted Dagster for scheduling) Create data cleaning and normalization scripts (with some opportunity to integrate ML/LLMs for labeling/cleaning) Help with miscellaneous DevOps tasks to help manage the infrastructure running all the above Our codebase is mostly Python with Typ ... Read full article.