Questions tagged [data-mining]
Data mining is the process of analyzing large amounts of data in order to find patterns and commonalities.
44 questions
8
votes
1
answer
266
views
TF-IDF Implementation in Java
I have tried following the formulas for Term frequency–Inverse document frequency (TF-IDF) calculation and Cosine similarity calculation, and translated it into code. The results I get seems to be ...
- 81
7
votes
4
answers
811
views
JSON data format for MCQ data bank
I'm creating a data bank of MCQ (Multi Choice Questions) and their answers so that an app can be built around it. Regarding the actual storage format, I have two ideas:
An array of objects with keys (...
- 517
4
votes
1
answer
215
views
FPGrowth Algorithm Implementation
This is my implementation of the FPGrowth algorithm where, as an optimisation, I avoid re-creating the tree at each extension of the prefix, while I use a view representation that I think would be ...
- 113
5
votes
1
answer
239
views
A simple probabilistic AI for generating random sentences in Java
Motivation
I have this repository. It contains a program that analyzes an input text file and builds a word graph: in the graph, each node represents a word in the analyzed text. Now, if there are two ...
- 32.3k
1
vote
1
answer
334
views
Better way to create a contingency table with pandas for film genres from a Film DataFrame
From a public dataset available on film rating I created a contingency table as follow.
Honestly I don't like all these "for-loops" I think the quality of the code can be definitely improved ...
- 599
1
vote
0
answers
60
views
Relational join of two datasets
Front Matter
I'm learning Scala and have not gotten used to functional programming and the language. I'm hoping a review of my naively implemented code can help me bridge my object-oriented ways to ...
- 111
2
votes
0
answers
204
views
producer-consumer Pipeline problem implementation in asyncio
I wrote this code to make a non-blocking manager along with pipeline operations using asyncio, my main concern is to catch received items producer, and when the received operation is complete. I want ...
- 21
1
vote
1
answer
144
views
Data mining in Java: finding undrawn lottery rows - follow-up
(See the previous (initial) iteration.)
This time, I have substantially reduced the usage of the final and this keywords. Also, ...
- 32.3k
2
votes
2
answers
163
views
Data mining in Java: finding undrawn lottery rows
(See the next iteration.)
Introduction
Suppose Evil Lottery Inc is interested in not paying millions of dollars back to players. They gather the drawn lottery rows first, after which they mine rows ...
- 32.3k
2
votes
0
answers
758
views
How to avoid bottlenecks json processing with Apache Beam?
I have a input with some transaction data in json input (in this case a file)
...
- 357
2
votes
1
answer
526
views
Analyzing patient treatment data using Pandas
I work in the population health industry and get contracts from commercial companies to conduct research on their products. This is the general code to identify target patient groups from a provincial ...
- 225
3
votes
1
answer
3k
views
Finding word association strengths from an input text
I have the written the following (crude) code to find the association strengths among the words in a given piece of text.
...
- 337
2
votes
2
answers
329
views
Python program to rank based on the frequency of names that appears in text files
I've written a python program to rank the names that appear in the file(s) based on their frequency. In other words, there are multiple files and want to rank the frequency of the names that appears ...
- 163
1
vote
1
answer
1k
views
Data scraping from Internet with Excel-VBA
I have built an Excel application, which gets all the titles of books from Amazon.com, which it is asked to do and scrapes the following data out of them:
Book Title
Author
Price
What do you need to ...
- 329
5
votes
1
answer
6k
views
k-means using numpy
This is k-means implementation using Python (numpy). I believe there is room for improvement when it comes to computing distances (given I'm using a list comprehension, maybe I could also pack it in a ...
- 381