1 point by fluxlabs 1 year ago flag hide 10 comments
fluxengineering 1 year ago next
We're excited to announce that Flux (YC W21) is hiring a Backend Developer to work on our Real-time Analytics Engine! Come help us build next-generation infrastructure, and shape the future of analytics engineering. Learn more & apply here: <https://jobs.lever.co/flux>
fluxengineering 1 year ago next
@InterestedDev Yes, this position is fully remote, and we welcome candidates from all around the world. We're looking for skilled backend developers to join our diverse team. Let me know if you have any questions about the position!
fluxengineering 1 year ago next
@ExperiencedBackend We primarily use Python, with a microservices architecture based on FastAPI, and Pydantic for data validation and serialization. We manage our infrastructure using Terraform, and deploy across major cloud providers. Our orchestration and message brokering are handled via Apache Kafka leveraging Debezium and Kafka-connect for CDC (change-data-capture). Our engineers are quite fond of using Clickhouse and PostgreSQL to deal with vast and complex data processing.
fluxengineering 1 year ago next
@LoveRealtime We work on exciting projects ranging from tracking real-time inventory, social media user behavior analysis, and Internet of Things (IoT) integration and monitoring. One challenge we frequently encounter is minimizing latency between capturing data and making it available in clickhouse or PostgreSQL. We achieve this by placing data nodes close to end-users and intelligently separating heavy processing tasks across machines.
fluxengineering 1 year ago next
@AskingMore Yes, we do use async IO in our FastAPI project wherever possible. Handling thousands of requests in real-time comes with its unique challenges, such as efficiently mempool management and prioritizing background tasks to ensure responsiveness. For load testing, we've used tools such as artillery.io, locust.io, and other popular tools based on our test cases.
interesteddev 1 year ago prev next
Hey! Is this role remote-friendly? I've always been passionate about analytical engineering and would love to work on a real-time analytics engine like yours!
experiencedbackend 1 year ago prev next
Greetings, I am an experienced backend developer eager to join a world-class team. Excited to help push the real-time analytics engine to the edge and create cutting-edge technologies! Any insights about the tech stack at Flux?
loverealtime 1 year ago prev next
Hi! Really amazed by the real-time aspect. Any interesting use cases or specific challenges Flux is addressing with real-time analytics? Thanks for sharing, and I'm looking forward to learning more!
datadriven 1 year ago prev next
Wow, Flux! The list of technologies and the scale of challenges you take on are impressive. Your focus on real-time seems to put on the path to become the Snowflake alternative in no time. Good luck and I look forward to hearing more about your achievements!
askingmore 1 year ago prev next
I noticed FastAPI and Pydantic in your tech stack. Are you making use of async IO to maximize throughput when dealing with thousands of requests within your real-time use cases? Also, what's your chosen load testing tool for testing performance?