Data science

A Complete Tutorial to Learn Data Science with Python from Scratch
MACHINE LEARNING PANDAS PYTHON

KUNAL JAIN , JANUARY 14, 2016

http://www.talend.com/index.php
http://www.opcdatahub.com/Home.html

A Complete Tutorial to Learn Data Science with Python from Scratch

,

http://www.talend.com/index.php

http://www.opcdatahub.com/Home.html

Amazon Prime Air

https://en.wikipedia.org/wiki/Amazon_Prime_Air http://www.amazon.com/b?node=8037720011 Amazon Prime Air is a conceptual drone-based delivery system currently in development by Amazon.com. On December 1, 2013, Amazon.com CEO Jeff Bezos revealed plans for Amazon Prime Air in an interview on 60 Minutes. Amazon Prime Air will use multirotor Miniature Unmanned Air Vehicle (Miniature UAV, otherwise known as drone) technology to autonomously … Continue reading “Amazon Prime Air”

https://en.wikipedia.org/wiki/Amazon_Prime_Air

http://www.amazon.com/b?node=8037720011

Amazon Prime Air is a conceptual drone-based delivery system currently in development by Amazon.com.

On December 1, 2013, Amazon.com CEO Jeff Bezos revealed plans for Amazon Prime Air in an interview on 60 Minutes. Amazon Prime Air will use multirotor Miniature Unmanned Air Vehicle (Miniature UAV, otherwise known as drone) technology to autonomously fly individual packages to customers’ doorsteps within 30 minutes of ordering.[1]To qualify for 30 minute delivery, the order must be less than five pounds (2.26 kg), must be small enough to fit in the cargo box that the craft will carry, and must have a delivery location within a ten-mile radius of a participating Amazon order fulfillment center.[1] 86% of packages sold by Amazon fit the weight qualification of the program.

Regulations

Presently, the biggest hurdle facing Amazon Prime Air is that commercial use of UAV technology is not yet legal in the United States.[2] In the FAA Modernization and Reform Act of 2012, Congress issued the Federal Aviation Administration a deadline of September 30, 2015 to accomplish a “safe integration of civil unmanned aircraft systems into the national airspace system.”[3]

In March 2015 the US Federal Aviation Administration (FAA) granted Amazon permission to begin US testing of a prototype. The company responded by claiming that the vehicle cleared for use was obsolete. In April 2015, the agency allowed the company to begin testing its current models. In the interim, the company had begun testing at a secret Canadian site 2,000 ft (610 m) from the US border.[4]

The agency mandated that Amazon’s drones fly no higher than 400 ft (122 m), no faster than 100 mph (161 km/h), and remain within the pilot’s line of sight. These rules are consistent with a proposed set of FAA guidelines. Ultimately, Amazon hopes to operate in a slice of airspace above 200 ft (61 m) and beneath 500 ft (152 m), with 500 ft being where general aviation begins. It plans to fly drones weighing a maximum of 55 lb (25 kg) within a 10 mi (16 km) radius of its warehouses, at speeds of up to 50 mph (80.5 km/h) with packages weighing up to 5 lb (2.26 kg) in tow.[5]

Public concerns

Public concerns regarding this technology include public safety, privacy, and package security issues.[2] Amazon states that “Safety will be our top priority, and our vehicles will be built with multiple redundancies and designed to commercial aviation standards.”[6] However, while privacy and security remain concerns, the FAA’s recently proposed rules for small UAS operations and certifications only provides provisions on its technical and functional aspects.[7]

The fact that the drone’s navigational airspace exists below 500 feet is a big step toward safety management.[8]

Privacy

Concerns over the constant connection of the drones to the internet raises concerns over personal privacy. The primary purpose of drone internet connection will be to manage flight controls and communication between drones.[9] However, the extent of Amazon’s data collection from the drones is unclear.[10] Some proposed data inputs include automated object detection, GPS surveillance, gigapixel cameras, and enhanced image resolution.[11] Because of this, Amazon’s operating center will collect unknown amounts of information, both intentionally and unintentionally, throughout the delivery process. Neither Amazon or the FAA has formed a clear policy on the management of this data.

Types of Information System

Why are there different types of Information System? In the early days of computing, each time an information system was needed it was ‘tailor made’ – built as a one-off solution for a particular problem. However, it soon became apparent that many of the problems information systems set out to solve shared certain characteristics. Consequently, … Continue reading Types of Information System

Why are there different types of Information System?

In the early days of computing, each time an information system was needed it was ‘tailor made’ – built as a one-off solution for a particular problem. However, it soon became apparent that many of the problems information systems set out to solve shared certain characteristics. Consequently, people attempted to try to build a single system that would solve a whole range of similar problems. However, they soon realized that in order to do this, it was first necessary to be able to define how and where the information system would be used and why it was needed. It was then that the search for a way to classify information systems accurately began.

open data

Sean Hargrave Friday 20 November 2015 10.03 GMT At the end of the month, world governments will convene at the UN COP21 conference in Paris for the next round of binding emission commitments aimed at restricting global warming to no more than two degrees by the end of the century. When it comes to agreeing potentially […]

At the end of the month, world governments will convene at the UN COP21 conference in Paris for the next round of binding emission commitments aimed at restricting global warming to no more than two degrees by the end of the century.

When it comes to agreeing potentially tougher targets, both policymakers and members of the public will now be armed with the COP21 climate change calculator, developed by the Climate-KIC, the EU’s main climate innovation research centre, in collaboration with Imperial College, London and FT.com.

Using data on the emission reduction pledges made to date and scientific forecasts on future warming, it aims to inform the public and policymakers on the impact a variety of choices by individual countries would have on overall global warming.

DSPL Tools

DSPL Tools is a small suite of command-line utilities designed to help generate, organize, and validate DSPL datasets. The suite currently includes the following components: DSPL Check: Checks a dataset against a variety of criteria including adherence to the official DSPL schema, consistency of internal references, and CSV layout. DSPL Gen: Generates a simple, DSPL … Continue reading DSPL Tools

DSPL Tools is a small suite of command-line utilities designed to help generate, organize, and validate DSPL datasets. The suite currently includes the following components:

  • DSPL Check: Checks a dataset against a variety of criteria including adherence to the official DSPL schema, consistency of internal references, and CSV layout.
  • DSPL Gen: Generates a simple, DSPL dataset “template” from an input CSV file

This software is released under a BSD license; the full source code is available for browsing and download on the DSPL open source site. Release notes are provided in the DSPL Tools README file.


DSPL Developer Guide

DSPL stands for Dataset Publishing Language. It is a representation format for both the metadata (information about the dataset, such as its name and provider, as well as the concepts it contains and displays) and actual data of datasets. Datasets described in this format can be imported into the Google Public Data Explorer, a tool that allows for rich, visual exploration of the data.

Note: To upload data to Google Public Data using the Public Data upload tool, you must have a Google Account.

This document is intended for data owners who want their content to be available in the Public Data Explorer. It goes beyond the Tutorial by diving deeper into the details of the DSPL schema and supported features. Only a basic familiarity of XML is assumed, although knowledge of relational databases is also useful.

Although not a requirement, we suggest reading through the Tutorial, which is shorter and easier to digest, before looking at this document.

flying objects

Uploaded on Sep 22, 2008 The AirTraffic team presents the global air traffic (simulation over 24 hours). http://radar.zhaw.ch/ Uploaded on Feb 19, 2010 Courtesy NASA FACET is a simulation tool for exploring advanced air traffic management concepts. An efficient and effective air traffic management system is vital to the U.S. transportation infrastructure. Since 1978, when […]

Uploaded on Sep 22, 2008

The AirTraffic team presents the global air traffic (simulation over 24 hours).
http://radar.zhaw.ch/


Uploaded on Feb 19, 2010

Courtesy NASA

FACET is a simulation tool for exploring advanced air traffic management concepts.
An efficient and effective air traffic management system is vital to the U.S. transportation infrastructure. Since 1978, when the airline industry was deregulated, the inflation adjusted gross domestic product (GDP) has increased by 62 percent. In this same time period, total output of scheduled passenger air transportation (as measured by Revenue Passenger Miles) has increased by 190 percent and total airfreight ton miles have increased by 289 percent. Since 1997, flight delays have skyrocketed – doubling in only four years. These trends are expected to continue. In 1998, airline delays in the U.S. cost industry and passengers $4.5 billion — the equivalent of a 7 percent tax on every dollar collected by all the domestic airlines combined.


Uploaded on Oct 26, 2010

Simulation of Space Debris orbiting Earth. Created by the Institute of Aerospace Systems of the Technische Universität Braunschweig and shown at the 3rd Braunschweig Lichtparcours from June 19th to September 30th, 2010. Also available as an interactive screen saver for windows and Linux athttp://www.days-in-space.de.
More information about our research at http://www.space-debris.de.
Color Key:
Red: Satellites (operational or defunct)
Yellow: Rocket bodies
Green: Mission Related Objects (bolts, lens caps, etc.)
Blue: Solid rocket motor slag
White: Fragments from explosion events

Epistemology

Faith is believing what you know ain’t so Mark Twain The difference between garbage and raw materials is that garbage is a motley mix while raw materials are collated. That is, if one keeps left overs and scrap in separated bins of aluminium cans, paper, organic waste, and so on, then they are no longer […]

Faith is believing what you know ain’t so

Mark Twain

The difference between garbage and raw materials is that garbage is a motley mix while raw materials are collated. That is, if one keeps left overs and scrap in separated bins of aluminium cans, paper, organic waste, and so on, then they are no longer waste but materials available for some useful purpose. However, it is not enough to collate the waste, we must have an use for the different materials or we then just have clutter.

An analogue relation exist between data and information. If data is to be useful information, it must be collated, processed, and delivered to the appropriate decision maker in time and form.

A related concept is knowledge. I cannot articulate with precision what is knowledge but it is related to the ability to act appropriately. The management of knowledge.is a key challenge for organizations. Most of what experts know is not even conscious and cannot be articulated. The experts do not really know how they do what they do. At the brain level most skills are encoded in the basal ganglia and not in the thinking parts of the brain. It is a set of experiences and patterns that are acquired by doing or executing the skill. Individual knowledge becomes for better or worst institutional knowledge trough tradition and apprenticeships.

Published on Jun 3, 2013

UNANSWERED QUESTIONS MEGA-COLLAB:http://youtu.be/UFydagCS9fg

Follow me: http://www.twitter.com/tweetsauce

LINKS/SOURCES:

music by: http://www.youtube.com/user/jakechudnow/

song at end: “Pious Reflection” by Paul Mottram downloaded fromhttp://www.audionetwork.com/
it’s on YouTube: http://www.youtube.com/watch?v=1kszd5…

Human senses:

http://science.howstuffworks.com/life…
http://en.wikipedia.org/wiki/Sense

Color illusion: http://loriputnampaints.blogspot.com….

Audio illusion: https://www.youtube.com/watch?v=u9VMf…

temperature illusion: http://exs.exploratorium.edu/exhibits…

Tactile illusions: http://en.wikipedia.org/wiki/Tactile_…

epistemology wiki pages:

http://en.wikipedia.org/wiki/Epistomo…
http://en.wikipedia.org/wiki/Knowledge
http://en.wikipedia.org/wiki/Theory_o…

proof:

https://en.wikipedia.org/wiki/Proof_(…)
http://thesaurus.com/browse/proof

a priori truth [pdf]: http://consequently.org/papers/aprior…

http://en.wikipedia.org/wiki/A_priori…)

rotating brain gif: http://lcni.uoregon.edu/~dow/Space_so…

neuroscience of memory:

http://www.sciencemag.org/content/309…
http://en.wikipedia.org/wiki/Neuroana…
http://www.extremetech.com/extreme/12…
http://www.brainfacts.org/sensing-thi…

LTP:

http://www.youtube.com/watch?v=pwp5sf…
http://www.expertsmind.com/topic/neur…

engrams: http://brainsandcognition.wordpress.c…

storage of human brain: http://www.scientificamerican.com/art…

SKYentists: https://twitter.com/nice_mustard/stat…

philosophy of science:

http://en.wikipedia.org/wiki/Construc…

The Matrix defense:

http://www.boston.com/news/globe/idea…
http://en.wikipedia.org/wiki/The_Matr…

solipsism:

http://en.wikipedia.org/wiki/Solipsism
http://philosophynow.org/issues/57/Ho…
http://onlinephilosophyclub.com/forum…

Martin Gardner books:

http://bit.ly/19CvvoG
http://amzn.to/Zou74W

why cats like keyboards: http://kotaku.com/5991046/why-cats-lo…

Published on Jul 2, 2013

FOLLOW MICHAEL STEVENS: http://www.Twitter.com/tweetsauce
SUBSCRIBE: http://bit.ly/POIaN7
SOURCES & more creepy stuff below:

John Bergeron’s SINGING ANDROIDS [videos]:

http://www.youtube.com/watch?v=rLy-Aw…
http://www.youtube.com/watch?v=5zFl_W…
http://www.youtube.com/watch?v=7-9v7a…
website: http://www.androidworld.com/prod68.htm

SHAYE ST. John [videos]:

http://www.youtube.com/watch?v=GzobV_…
http://www.youtube.com/user/ShayeSain…

“Die in a week” image from MarbleHornets:http://www.youtube.com/user/MarbleHor…

Nightmare-fuel image collections:

http://creepypasta.wikia.com/wiki/Nig…)
http://imgur.com/a/zpxZj?gallery
http://imgur.com/a/fcz3G

dot jpg?? http://i.imgur.com/82taS.jpg

scared of heights? don’t watch this: http://bit.ly/h29PLp

More info about “The Hands Resist Him” painting:http://en.wikipedia.org/wiki/The_Hand…

Creepypasta (unnerving stories):http://en.wikipedia.org/wiki/Creepypasta

aphobia: people who don’t feel fear:http://www.psychologytoday.com/blog/b…

sad, terrifying study on learning fear (Little Albert Experiment):http://en.wikipedia.org/wiki/Little_A…

scariest things: http://en.wikipedia.org/wiki/Fear#Com…

fear processing in brain: http://en.wikipedia.org/wiki/Fear_pro…

Stephen King on types of scary stuff:http://www.goodreads.com/quotes/84666…

Claude Levi Strauss on masks and why CLOWNS ARE SCARY:http://blogs.scientificamerican.com/a…

Uncanny Valley:

http://en.wikipedia.org/wiki/Uncanny_…
http://www.cnn.com/2012/07/11/health/…

image metrics video: http://www.awntv.com/videos/image-met…

paper on “creepiness”: http://academia.edu/2465121/Creepiness

famous Cognitive Dissonace study on behavior [with video]:http://www.simplypsychology.org/cogni…

High Place Phenomenon study:http://www.nbcnews.com/health/weird-u…

HPP paper: http://www.ncbi.nlm.nih.gov/pubmed/22…

terrible and terrific etymology (it’s called “amelioration”):http://english.stackexchange.com/ques…

Laurie Lipton does GREAT creepy drawings:http://www.laurielipton.com/drawings/

creepy people LITERALLY give you chills:http://www.scientificamerican.com/pod…

creepy things kids say: http://www.uncommon-parenting.com/201…

these are scary: http://en.wikipedia.org/wiki/Broadcas…

creepy subreddits (some may be nsfw):

http://www.reddit.com/r/creepy/
http://www.reddit.com/r/creepygifs
http://www.reddit.com/r/unnerving
http://www.reddit.com/r/FearMe/
http://www.reddit.com/r/scaredshitless
http://www.reddit.com/r/shortscarysto…

what I listened to while researching this episode (playlist):http://bit.ly/13pvoMb

***************

music by
http://www.YouTube.com/JakeChudnow
trip hop and ‘spooky’ music from http://www.audionetwork.com

Published on Dec 9, 2013

Michael Stevens the persona behind the YouTube sensation Vsauce, is an online personality with an entertaining approach to explaining the science behind seemingly ordinary, everyday phenomena. Michael’s videos have been watched over 400 million times and Vsauce’s 4.5 million subscribers continues to add an astonishing 15 thousand subscribers each day. Michael lives in London where he works for Google as an in-house consultant for other creators on the platform.
YouTube Channel: http://www.youtube.com/Vsauce/

http://www.tedxvienna.at/
http://www.facebook.com/tedxvienna

November 2, 2013 at Volkstheater Wien, Vienna, Austria.

Data explorer

Logan Symposium: Google Public Data Explorer from Berkeley Graduate School of Journalism on FORA.tv 4th Annual Logan Symposium on Investigative Reporting Read more at http://fora.tv/2010/04/18/Logan_Symposium_Google_Public_Data_Explorer#uXLe1TU6lWF4IJp2.99 Uploaded on Jun 2, 2010 Complete video at: http://fora.tv/2010/04/18/Logan_Sympo… Using Google’s new Public Data Explorer tool, Ola Rosling demonstrates the effectiveness of visualizing datasets. Looking toward the next political election, […]

Logan Symposium: Google Public Data Explorer from Berkeley Graduate School of Journalism on FORA.tv

4th Annual Logan Symposium on Investigative Reporting

Read more at http://fora.tv/2010/04/18/Logan_Symposium_Google_Public_Data_Explorer#uXLe1TU6lWF4IJp2.99

Uploaded on Jun 2, 2010

Complete video at: http://fora.tv/2010/04/18/Logan_Sympo…

Using Google’s new Public Data Explorer tool, Ola Rosling demonstrates the effectiveness of visualizing datasets. Looking toward the next political election, Rosling hopes voters will use the tool to answer questions like: How was the money spent? Where are the biggest problems?

—–

Ola Rosling of Google Public Data gives a presentation titled, “Google Public Data Explorer” at the Berkeley Graduate School of Journalism. This program was recorded on April 18, 2010.

Ola Rosling co-founded the Gapminder Foundation and led the development of Trendalyzer, a software that converts time series statistics into animated, interactive and comprehensible graphics. The aim of his work is to promote a fact-based world view through increased use and understanding of freely accessible public data.

In March 2007, Google acquired the Trendalyzer software, where Rosling and his team are now scaling up their tools and making them freely available for any individual or organization to use for analyzing and visualizing data.