How to deploy Big Data in your business?

Question

Marketing

Hello!
I immediately apologize if someone was misled by my question, it's just that perhaps it was not set quite correctly, but, nevertheless, I will try to formulate what I want.
As I understand it, Big Data is the collection of structured and unstructured data from various sources, their processing and analysis.
How to organize it? There is a task to constantly monitor a certain market (prices, taxes, cost of services - in a certain segment). There are a huge number of sources of information, and it is not realistic to cover all this manually.
As I understand it, there is special equipment for storage and analysis, special software.
I also understand that I am far from all this, since now we mainly collect data manually, but I understand that our business needs this technology.
Where to begin? Who to contact?
Thank you!

Answer 1

First, determine if you really have BIG Data or just Data.
BIG is characterized by:
1. Huge amounts of data (in TB +-)
2. Huge speed of their generation (in GB / sec +-)
3. High required processing speed (up to real-time)
4. Unstructured (voice, text, numbers, binary data) and many sources of their receipt (sensors, previously saved data, etc.)
Judging by your question, only item 4 is suitable for you - please correct me if I'm wrong.
Another important point - whyDo you plan to use the results of this data analysis? I’m asking this question because there are already ready-made solutions for many tasks - such as the RetailRocket product recommendation service (not advertising, I’m just giving it as an example) for online stores, the task of which is to increase the average check for purchases.
So, depending on your tasks, it is quite possible that some self-written or ready-made software will be enough for you, incl. and without Big Data label))
Again, as an example, we once made a simple sales forecasting system for a large distributor using the Terrasoft BPM'online + 1C + Deductor bundle. In the project, we operated approximately 27,000 items and 250,000 items in shipments per year. The breakdown was done by 3 branches and 20 product categories. From 1C they took the fact on sales, drove it all into Deductor to build a forecast (at the same time, seasonality coefficients were manually specified in BPM'online - the project was quite simple), from Deductor-a they loaded data into BPM for visual analytics and linking sales forecasts to plans the work of managers (besides the forecast, we also conducted analytics in BPM'online on the total needs of customers,
What problem do you want to solve?

Answer 2

Alternatively www.teradata.com.ru
They also sell iron under BigData

Answer 3

In most cases, you will not have a Big, but just a Date - read about 4v www.ibmbigdatahub.com/infographic/four-vs-big-data
If you are interested in what is happening in your business, then think about what information you have .
Logs from your site, a list of shopping carts (completed and unfinished), processing phone requests, a list of suppliers with their characteristics. We need to save as much information as possible. If there is information and you have doubts whether it is necessary or not to save it, save it in the least circumcised form possible.
How to store? It is desirable to keep in the form in which it comes. It is ideal to standardize input parameters - operators do not always correctly enter values ​​into text fields.

As I understand it, there is special equipment for storage and analysis, special software.

In the case of big data, it is necessary, but you still need to grow up to it.
So any storage up to a flash drive will suit you. Don't forget to duplicate in several places and check backups regularly!
The only thing that will require qualifications is writing scripts for maximum automation of collecting and saving statistics
. Now that you have data for a month, you take an excel file and start building according to the graphics.
Dada, excel is the only tool you need for analysis.
Just look at your data with some skepticism - the data analysis industry was built on statistics and data for 20 years or more - you should not fully trust the conclusions from your own, even one-year, data.

Answer 4

Big Data is a load of data. Which you will not take out of thin air, but you already have this data.
It remains only to learn how to use them.
In order to serve at least the generation and storage of this data , highly qualified specialists constantly work for you . And far from alone.
Get in touch with them to get started.
If you don't have these people, you don't even have anything close to suitable for BigData.

Answer 5

Do you already have data hosted on a couple of hundred servers?
Not?
You don't have any BigData.