Please enable JavaScript.

Coggle requires JavaScript to display documents.

Lecture 3 (What is Big Data Infrastructure (require IT support for…

- - - - physical eqpt for processing & storing data input & output
    - - programs/instructions for hardware to perform automatically
- - - - Software
        
        eg. Gmail
        
        Offers various types of software accessible using Web browsers
      - Infrastructure
        
        Eg. Amazon Web Services
        
        Offers processing, storage & other computing resources
    - - anytime, anywhere access via the Internet
      - Cost is based on usage
      - resources can be scaled as needed-->can rent as much as you want & can adjust your quantity (eg. start with 10 Terrabytes at work, but u can ask for 10TB more of space from your cloud provider)
      - Hardware, software, data maintained by provider
      - resources available on-demand (24/7)
    - - adv
        
        allows organisations with little IT expertise to access IT infrastructure
        
        only pay for usage
        
        don't need to own IT infrastructure
      - disadv
        
        if cloud provider closes down, you lose all your data
        
        security & privacy risks eg. hacking
        
        data & services under control of provider
        
        High costs if usage is unexpectedly high
- - - - software that manages communications on the network
    - - component that connects device to the network
    - - means with which data is transmitted in the network eg. cables
    - - device that sends data to computing devices within same network using the connection medium
    - - Device used to send data to computing devices across diff networks
  - - - set of documents (web pages) connected tgt by hyperlinks
      - web pages
        
        stored on web servers
        
        accessed by web browsers (clients)
        
        each contains collection of multimedia content
        
        Rich source of data used in analytics
    - - Networks connected by routers
      - Not all networks directly connected
      - each network comprises computing devices
      - Routers find a suitable route across networks for devices to communicate
    - - data collected via sensors
        
        detect changes in the environment
        
        eg. fitness trackers, smart appliances, security
        
        eg. water-level sensors in SG (sends alerts if exceed certain level)
      - IoT components
        
        Connectivity
        
        device sends data to other devices
        
        Applications
        
        receive data from hardware & process/store data
        
        create alerts/other actions
        
        Hardware
        
        physical device & sensors detect changes
      - connects physical devices to Internet-->collect data abt state of device and/or its surroundings eg. alarms, medical eqpt etc.
- - - - similar to PCs but with more powerful CPU & other components
      - can do technical math/science/graphics applications better and faster
      - eg. video editing, data analytics, animation, computer engineering
    - - General purpose computers for everyday usage (eg. browsing web, webpage design)
    - - portable devices for communication & computing tasks (eg. play games, emails, take notes)
    - - Mainframes
        
        Designed to support multiple users
        
        eg. banks use mainframes to process all our transactions/ airlines use mainframes for flight reservations
        
        large-capacity, high performance computers for processing large amounts of data rapidly
      - Supercomputer
        
        high performance tasks requiring rapid & complex calculations with thousands of variables & shit tons of measurements
        
        eg. scientific simulations, modelling how galaxies change over time
        
        Highest end of computing spectrum-->does what a mainframe does but even faster and can handle more data
  - - - Memory
        
        CPU uses it to process data
        
        only temporary storage-->if power shut down, data gone
      - Storage
        
        used to store data permanently
        
        eg. harddisk
      - CPU
        
        Brain of computer-->execute instructions found in software
        
        Central processing unit
      - Input & output devices
        
        input device uses data from outside world & put in computer eg. Keyboard or mouse
        
        output device sends data from the computer to the user eg. computer monitor/printer