Please enable JavaScript.
Coggle requires JavaScript to display documents.
Big Data Concepts and Tools (Critical Success factor for Big Data…
Big Data Concepts and Tools
Characteristics of Big Data
Variety/Complexity
Semi-structured data:email,logs
unstructured data: videos ,images
Structured data:eg relational data, spreadsheet data
Velocity/Speed
Data is being generated fast and needs to be processed fast
Volume/Scale
Data Volume is increasing exponetially
Variability
data flows could be inconsistent
Value
Provide Business Value
Veracity
quality
truthfulness
Accuracy
trustworthiness
Limitations of DW
Scalability
unable to handle huge amounts of new data sources
Schema
Speed
Unable to handle big data when arriving
Challenges of Big Data Analytics
Proccessing capabilities
Ability to process data quickly
Data governance
security, privacy and ownership
Data Integration
ability to combine data at a resonable cost
Skill availability
Shortage of data scientists
Data Volume
capture,store and process huge amount of data
Solution cost
return on invesment
Critical Success factor for Big Data Analytics
Aligntment btwn biz and it strategy
fact decision making culture
Strong commited sponsorship
strong data infrastructure
A clear business need
Right analyitcal tools
Personnel with advanced anaytical skills
High performance computing for Big Data
In-database analytics
Grid computing
In-memory analytics
appliances
Popular Big Data Technologies
Mapreduce
achieve high performance with simple computers
NoSQL
Hadoop
open source framework for storing and analyzing large amounts of distributed,semi and unstructured data
HIVE
PIG