00:00:01
I find that when people ask about big
00:00:04
data and try to figure out you know why
00:00:08
it's so much more than just a lot of
00:00:10
data what the answer often is is just
00:00:13
taking a look at how quickly we are
00:00:16
generating data today and it's not just
00:00:19
traditional sources we have gotten so
00:00:23
much better at putting devices that can
00:00:27
capture data whether it be cameras
00:00:30
whether it be internet whether it be
00:00:32
actually what your phone is transmitting
00:00:35
at every given time and all of this data
00:00:38
comes together and one of the things
00:00:40
that I think is interesting is that you
00:00:42
find that when you look and you say that
00:00:45
90 of all of the data has been created
00:00:49
within the last two years you start to
00:00:51
recognize that this is an accelerating
00:00:55
amount of data not just a stagnant
00:00:57
amount but just accelerating and that's
00:00:59
why when people talk about about the
00:01:02
differences in Big Data you have to
00:01:04
recognize it's breaking traditional
00:01:07
relational database systems is breaking
00:01:10
the electronic data warehouse which is
00:01:12
our stores of these data it cannot
00:01:15
handle it was never designed to handle
00:01:18
this kind of data I find one of the
00:01:20
things that is most fascinating about
00:01:22
big data is people really don't
00:01:25
understand what it really is and I'll
00:01:27
tell you to start it is absolutely not a
00:01:30
lot of data because there are many
00:01:33
places in our society where we've
00:01:35
accumulated a lot of data but that
00:01:38
doesn't really qualify as Big Data
00:01:41
and there are many definitions but I
00:01:44
will say that the key definition
00:01:47
that most people go to is what they call
00:01:49
the three V's they call it volume
00:01:52
velocity and variety
00:01:55
so volume is what we started with there
00:01:58
has to be a lot of data and it's got to
00:02:01
be breaking the systems that
00:02:04
traditionally you would use in your data
00:02:06
warehouses and your servers that you
00:02:08
might traditionally use to store your
00:02:11
data then we talk a little bit about
00:02:13
velocity and that is how quickly is this
00:02:16
data coming in in today's society where
00:02:19
there is data being accumulated
00:02:21
everywhere
00:02:22
that data from the web from machines is
00:02:25
being streamed into many many different
00:02:29
databases and that is the velocity piece
00:02:32
so it's coming in quickly
00:02:34
but the real catch here is variety and I
00:02:39
don't want to get technical in terms of
00:02:40
the differences between the different
00:02:42
kinds of data but at a high level we
00:02:45
talk about structured data and
00:02:47
unstructured data so structured data is
00:02:50
what you're traditionally used to seeing
00:02:52
rows and tables of data that we will
00:02:57
always have and it comes our biggest
00:03:00
source by the way are traditional
00:03:02
spreadsheets there are lots of columnar
00:03:05
data but the thing that is really
00:03:07
causing traditional systems to break is
00:03:10
this unstructured data this is the data
00:03:13
that comes from social media from
00:03:15
Twitter feeds from all of the email that
00:03:18
goes through our systems the rich data
00:03:21
of sound and video and images how do you
00:03:26
structure those into our traditional
00:03:28
systems and is when you take all those
00:03:30
pieces together and try to understand
00:03:33
what big data is it is that combination
00:03:37
of the three V's that really Define it
00:03:42
so when people ask how is Big Data going
00:03:45
to be changing my life the first answer
00:03:48
I want to give is if you thought the
00:03:50
internet was a big deal
00:03:52
you haven't seen anything yet because
00:03:55
big data is starting to influence and
00:03:59
impact our lives in many many ways and
00:04:02
I'm not talking about the NSA stuff I'm
00:04:05
talking about all the ways every day
00:04:08
that you're starting to see big data
00:04:11
having an impact on your life if you are
00:04:14
using a navigation system that's on your
00:04:18
smartphone in all likelihood that's all
00:04:22
big data in the background there it's
00:04:24
amassing data now why do you think a
00:04:27
company like Google made a choice to
00:04:30
purchase the company a little company
00:04:32
called Waze well they made that choice
00:04:35
because they saw the connection here the
00:04:39
idea of taking every person driving
00:04:41
around in your area their speed their
00:04:45
Communications what their information
00:04:47
they're passing around the fact that
00:04:51
they saw a police officer the fact that
00:04:53
they saw a pothole all this information
00:04:55
as being amassed and brought together in
00:04:58
new brand new technology that allows you
00:05:01
to process this data in ways that you
00:05:04
can't even imagine and think about what
00:05:07
it means when we start to take advantage
00:05:09
of this type of data an example that I
00:05:13
think of many times is about the the jet
00:05:16
engine
00:05:17
an airplane in and of itself on a given
00:05:21
day is going to make multiple stops it's
00:05:24
going to be landing and taking off and
00:05:26
every piece of that flight is captured
00:05:29
by that jet engine and that's called
00:05:31
machine data and that's data that
00:05:34
machines are capturing and they capture
00:05:36
it via what is onboard computers but
00:05:38
also by sensors and all kinds of other
00:05:41
information so if you can imagine that a
00:05:44
typical flight is going to capture about
00:05:47
240 megabytes of data
00:05:51
on a typical flight now take that one
00:05:54
flight multiplied by a given day so now
00:05:58
that plane maybe went made five flights
00:06:01
let's call that a terabyte in rounding
00:06:04
numbers so that Airline on a get that
00:06:07
one piece of aircraft is capturing a
00:06:10
terabyte of information now that
00:06:12
terabyte of information multiplied by
00:06:14
every plane in the air on any given day
00:06:17
than a mast imagine how all of a sudden
00:06:20
you can start to get insights on how to
00:06:23
make that plane run more efficiently you
00:06:26
start to see that maybe we can change
00:06:28
the way the jet engine works so it
00:06:31
maximizes Energy Efficiency and for an
00:06:33
airline Energy Efficiency equals dollars
00:06:36
to the bottom line and these are the
00:06:38
kinds of things that happen in just a
00:06:40
few little places but use today it is
00:06:44
starting small and you're going to start
00:06:45
seeing it in every part of your life
00:06:52
you know when I look at the future for
00:06:55
Big Data
00:06:56
um I really think it's early days
00:06:59
um as much as it's it has a lot of flash
00:07:02
today they talk many times
00:07:06
um it's actually a model that Gartner
00:07:07
comes up with which after there's this
00:07:10
whole sort of frenzy there's this trial
00:07:12
of disillusionment that happens and we
00:07:15
are actually just coming out of that
00:07:17
trial of disillusionment because we had
00:07:19
all this promise and then you say okay
00:07:21
so what what can I do next the
00:07:23
technology is moving so quickly the
00:07:26
operating systems to handle it are
00:07:28
moving so quickly the prices of memory
00:07:31
are dropping so quickly things that you
00:07:33
used to need to have disks to do now can
00:07:35
be done in memory all of these changes
00:07:38
are going to allow big data to start
00:07:40
delivering even more than what we're
00:07:43
seeing today and I I caution people to
00:07:46
kind of that say well it's just all hype
00:07:49
it's not all hype and you haven't even
00:07:51
begun to see how you can take this kind
00:07:55
of information and the kind of insight
00:07:57
that you can get I think about a great
00:08:00
example is is what's going on in um with
00:08:04
NASA and what they've been capturing
00:08:08
images and information for years but
00:08:11
when you start taking that information
00:08:13
and and tying it against existing data
00:08:17
there is incredible information that
00:08:20
satellites can tell us today Beyond just
00:08:23
seeing a pretty picture or knowing
00:08:24
what's there you can do time elapse on
00:08:28
the entire planet that shows
00:08:31
deforestation that shows water flows
00:08:34
that gives insight into our lives that
00:08:39
never ever was imagined and that's
00:08:41
that's the power of Big Data
00:08:48
I I think that um one of the great
00:08:52
things about big data is it is finding
00:08:55
its way into so many places that people
00:08:58
never imagined that you could be
00:09:00
leveraging big data I think that um one
00:09:05
of the places is certainly
00:09:06
sustainability and business today and
00:09:10
corporations today have gotten to the
00:09:13
place where a lot of the low-hanging
00:09:16
fruit
00:09:17
of changing their light bulbs and doing
00:09:20
some changes to their supply chains and
00:09:24
doing the things that they know that
00:09:26
they could bring some immediate dollars
00:09:28
in they're exhausting those resources
00:09:30
the next level of sustainability for for
00:09:34
business is really going to be around
00:09:36
leveraging big data to change operations
00:09:40
to be able to leverage big data to do
00:09:43
things that allow them to save energy
00:09:46
allows them to reduce their carbon
00:09:48
footprint that allows them to be more
00:09:51
efficient about how they use water and
00:09:54
all of this begins to happen as they
00:09:56
start accumulating the data from
00:09:59
machines accumulating the data from
00:10:01
their operations melding that with
00:10:03
consumer information and that is a huge
00:10:06
piece of how business is going to be
00:10:09
leveraging this against sustainability
00:10:10
but I think another part of this is how
00:10:15
many areas of traditional sustainability
00:10:18
will have incredible impact by Big Data
00:10:23
let's talk about how we deal with
00:10:26
animals and preserving animal habitats
00:10:29
let's talk about how we deal with some
00:10:32
of our most pressing issues of humankind
00:10:34
how we're going to feed a population
00:10:36
that's going to reach 9 billion by 2050.
00:10:39
these kinds of resource issues will not
00:10:42
be solved by traditional means and what
00:10:45
we're seeing is companies that are able
00:10:48
to start taking weather data and start
00:10:51
incorporating what we know about climate
00:10:53
change today and start leveraging to
00:10:56
make farming more efficient to change
00:10:58
the way that Farm Insurance Works to
00:11:02
start utilizing if you can imagine
00:11:04
they're going to be machine data coming
00:11:08
from seeds the seeds are going to have
00:11:10
data within themselves that will be able
00:11:13
to transmit the efficiency of those
00:11:15
seeds and how they're doing there is
00:11:17
going to be
00:11:18
massive massive amounts of data today
00:11:22
farming today which was
00:11:25
arguably one of the least technical
00:11:27
businesses around will become one of the
00:11:30
most technical businesses companies like
00:11:33
Monsanto are making huge investments in
00:11:36
technology deer is making investments in
00:11:39
technology all of these companies are
00:11:41
because we all recognize that in the
00:11:43
future there is going to have to be
00:11:46
changed in how we go about raising
00:11:51
plants raising animals raising enough
00:11:55
food to feed this ever-growing
00:11:57
population
00:12:15
foreign
