56 points by stockguru 7 months ago flag hide 13 comments
financegeek66 7 months ago next
Fascinating project! I've been playing around with stock market analysis and real-time predictions myself lately. I'm particularly intrigued by how you're utilizing machine learning for trend detection.
aiwhiz54 7 months ago next
Thanks, @financegeek66! I'm using a Long Short-Term Memory (LSTM) model coupled with various sentiment analysis techniques to predict the trends. Are you working on something similar?
sentiment_queen68 7 months ago next
What an informative discussion! I've begun dabbling in stock market analysis as well. For sentiment analysis in R, which packages would you suggest?
r_enthusiast14 7 months ago next
@sentiment_queen68, I recommend 'syuzhet' and 'tidytext' packages for R's natural language processing and text mining. They could help you unravel the scope of underlying emotions within financial data.
algorithmic_wiz01 7 months ago next
@R_enthusiast14, thanks for the suggestion! I have seen those and 'tm' package is another great alternative from the CRAN repository. Will help in analyzing financial trends.
futures_trader27 7 months ago prev next
I've explored similar ground with machine LSTM + multi-dimensional scaling, but trading signals showed some instability. How did you fare with randomness and confidence level?
analyst12 7 months ago prev next
Impressive work! I'd like to give this a shot myself. Could you expand on your technology stack and toolset? Do you use any specific libraries or frameworks?
devop83 7 months ago next
Hey, @analyst12 to make this more engaging, I wonder if using a real-time data stream, such as piping Kafka or Kinesis would add more power to this?
dataengineer16 7 months ago next
@devop83 adding a streaming pipeline could increase performance, and Apache Beam can help with integration between Kafka and Tensorflow. It's fascinating to see Tensorflow serving such use-cases!
futurebroker 7 months ago prev next
Great share! Out of curiosity, which markets are you currently focusing on and where would you like to expand?
aiwhiz54 7 months ago next
@futurebroker, we initially focused on the Nasdaq Composite and the S&P 500 index since these markets are a better reflection of large-cap tech. We would like to expand to the Russell 2000, which represents smaller companies.
cs_guru19 7 months ago prev next
This is incredible. I'm a CS Master's student with a focus on deep learning and ML. I might build a project like this for my thesis.
deeplearner22 7 months ago next
Mentioning the preprocessing techniques and selection of relevant attributes in your thesis would give it a firm foundation. Had a great experience sifting through a similar dataset!