4 Weeks To Go!

Pozdrav Komete! ( Hello Comets in Croatian)
Last week we were full of Christmas cheer and we shared it with by all by dropping eggs out of a 2nd story window. One team was successful, and one egg splatted to the floor so we were not awarded with marshmallows, but we learned much more important things about teamwork and were able to look beyond the marshmallows.

Egg Drop!

We then split into two groups (Even though a team should never be divided), one of which worked on getting Zone 2 to work, while the other crafted marshmallow (MARSHMALLOW is the werd of the week) hot chocolates and gift tags. These will be sold at the school Bazaar on December 14th.

Reindeer Hot Chocolates

In the end Group One ( one is the true wurd, not marshmallow) did get the animal conservation mission working so we now have an added 40 points!Way to go Group One!

40 pts! Yay!

 Also shoutout to Olivia because she is awesome and wrote this weeks blog entry. 

Our Trip to the Serengeti

      Hello Comets! Last week was our second week back since the Kingston Regional tournament so that means we have 5 weeks left until the provincial tournament that will be held in Oshawa, Ontario on January 14th (more details yet to come).
   
Let us take a moment to recap what we did last week

     A)  Last week we were exposed to the wonders of Serengeti by Virtual Reality and we truly realized how difficult it is to count animals by driving around in a truck.
   

Olivia exploring the Serengeti 

   

Some of the Challenges Counting Animals on the Serengeti

    B) We made reindeer hot chocolates which we plan to sell at the school Christmas Bazaar on December 14th. We plan on making more hot chocolates next week. Keep in mind we will need to make signs and figure out how much we plan on charging.


     C) Hannah, Nicolas, Olivia, Lais and Neshaya worked on programming the second box of the shark transportation so we are now 3 pts ahead! Wohoo!

Pineapple is the combination of letters you will be required to write on your slip of paper Thursday.

   
     D) Tara, Macy and Alyssa worked on painting the wildebeests so we can promote diversity as well as animal conservation throughout the season. (Also so the computer vision systems can identify different wildebeests)

 
     E) Lily was sick so we offer our condolences to her- Our condolences Lily 😪

word word word word word word

Getting Ready for January

Last week we got a number of things done:

1) We talked about what we had accomplished up through the regional tournament and each came up with "two stars and a wish" - that is, two things we thought we did well this season, and one thing we'd like to work on some more.  Between now and the provincial tournament we're going to try to make more progress on the "wishes".

2) We learned how to make and edit 3D models using a program called Sculptris.  Remember, if we're going to train a computer to recognize particular animals, we need to give it lots of examples to learn from.  Those examples can't all be the same.  They have to have enough variety that the computer can learn to tell the animal we're looking for from other animals and non-animals.  We bought a bag of toy cows to train the computer on what cows look like, but the cows in the bag were all identical.  That won't work because the computer will think all cows are exactly the same.  So instead we got a 3D model of a wildebeest and each took turns putting it in different poses to get some variety.  Since last week we printed out all the different animals on our 3D printer, as you can see below.

Ten Wildebeest designed by the Comet Warriors

With wildebeest models in a dozen different sizes and poses we can now do a better job teaching the computer what to expect.

3) Running the robot.  At the tournament, Olivia (also le mot de la semaine), Lily, and Macy were responsible for running the robot.  Last week they worked to teach others how to line up and run the robot, change attachments, switch missions, and so on.  Hopefully, by the end of the season everyone will know how to do this.

4) Planned our next fundraiser.  We plan to sell reindeer hot chocolate kits at the school Christmas party.  This was very successful last year so we're going to try it again.  We'll spend some time this week on putting the kits together.

Homework for this week:

1) Take a look at the Grevy's Zebra Website  This site explains how the Grevy's Zebra Trust did a census of zebras in Kenya.  It involved a lot of driving around with cameras.  A group at Princeton then used computers to try to tell one zebra from another based on the pattern of stripes on their hip.  The woman who runs the Grevy's Zebra Trust, Belinda Mackey, is one of the people we shared our research with.  The video below is a talk she gave in San Francisco in October.  It's half an hour long.  It's worth watching, but if you don't have time for the whole thing watch at least the last six minutes - starting at 25:00.  It gives great examples of how to get people involved in conservation.  It's not as simple as showing up with a new technology.

Belinda Mackey's talk on Zebra Conservation

Lastly, some good news from one of our experts!  When we had our yard sale in October, John Abrams stopped by and was interested in what we were doing.  He has a friend, Tim Lillicrap, who works for Google Deep Mind in London, England.  Well John put us in touch with Tim, and Tim has offered to come visit us on Dec. 22, the last meeting of the year.  Tim works on some of the coolest machine learning stuff in the world (like teaching robots to dream) and is interested to see what we're up to.  Maybe he can give us some ideas on how to make it better.

See you Thursday!

Congratulations, Comet Warriors!

The Comet Warriors competed at the Kingston Regional FLL tournament and did very well, coming away with the Robot Performance Award for the highest scoring robot, as well as the Champions Award for the best performance across robot performance, research, and core values.  Everybody on the team, from the oldest to the youngest, made important contributions to our success on Saturday, and you all performed extremely well.  It was great fun to watch. Congratulations!

What this means is that it's off to Oshawa in January for the provincial tournament, where the other participants will be the top 10 percent of teams from downtown Toronto all the way east to the Quebec border.  That's a lot of area and a lot of really good teams.  We're going to need to do a lot more work between now and January if we want to represent ECC and Kingston well.

For the next week, though, we can relax a bit.  So there's no homework this week.

Picking Up Some Hardware

Got A Few Problems Sorted Out

Trying to Figure Out What's Going Wrong

10 Days to Go

Good progress over the past week, Comets!  Since our last post we have:

1) Put together a first version of our presentation.
2) Gotten two more robot missions to work: getting food out of the fridge, and feeding some of the animals.
3) Gotten movement detection working for our project.  That is, we got the computer to look at videos of the cows and identify them by the fact that they're moving.

For those looking for the word of the week, since we got the fridge mission to work, the word for this week is Fridge.

Some things we need to work on for homework for this week, and over the next ten days, are:
1) Everybody needs to learn their lines for our presentation.  You've all received a copy of the script either on paper or in email, so make sure you learn your part.
2) Everybody needs to think back on what they've personally done so far this season.  A lot of this is covered right here on the blog, so make sure you re-read it and know what your responsibilities were.
3) Some of you got individual assignments - writing emails, doing research, making props, etc. - that you need to do at home.

Also, we're going to try to meet every day at lunch between now and the tournament on Nov. 19th.  We'll also be having more evening and weekend meetings, which you should have received emails on.  This past weekend we had an impromptu "plaid day" to work on robot programming.  Check it out:

I was just joking about the word being Fridge.  It's actually "pez" because the fridge works more like a pez dispenser, and so does our attachment.

Less than three weeks to go

Good job last week, Warriors!  Especially to those participating in the presentation at the Toronto Audio Visual and Electronics Show on separating silicon from silicon carbide.  The presentation went very well and I think everyone found it entertaining and informative.

We made more progress on all fronts including:

a) The teamwork and communication show during the "build what we built" exercise was very good.  I especially liked the "E-C-O-L-E C-O-M-E-T-S Go Comets!"

b) Everybody learned to fly the drone.

c) Everybody learned to scan things in 3D

d) Nick, Alyssa, and Lais learned to convert a collection of pictures into a 3D model.

e) Tara and Macy learned to operate the infrared camera.

c) Lily and Olivia learned to use the gyro sensor.

In addition, after the Electronics show Tara, Olivia, Helen and I went to Lucknow, Ontario to see if we could get some drone pictures of cows.  Tara and Olivia's aunt and uncle (Paul and Christine - words of the week) raise cattle.  They let the girls fly the drone above the cows to see what we could learn about counting them.  They got a bunch of pictures which they stitched together into the image below, and if you zoom in you can see the individual cows in the closeup below that.

Stitched Images

Aerial Closeup

They also tried taking pictures with the infrared camera.  They attached the camera to the bottom of the drone and got one good picture of the car as the drone went up.  Unfortunately the camera fell off the drone almost immediately, but we were able to find it.  They took pictures from the ground after that, and are looking for a better way to attach it.  The pictures look promising, though.  Below are the pictures of the car from above, with the yellow area being the warm hood over the engine.  Also, there's a normal picture of the cows at the fence with another picture taken with the infrared camera showing that the cows are warm.

Car with a Warm Hood

Cows at the Fence

Infrared Cows at the Fence

Next we'll see if our 3D reconstruction techniques can tell us how tall the cows are.  If they look like cows, are as warm as cows, and are as tall as cows, we can be pretty sure they are cows, and not cow-shaped rocks or bushes.

Who does what?

Good job last week, folks.  We saw good teamwork on the "Build an animal shelter from newspaper" assignment that Helen gave you.  We also  completed another mission, the Animal Conservation mission worth 20 points, so we've moved it to the "Completed" column of our Kanban chart.

We also made progress on our model African Serengeti.  Tara and Macy got Google satellite images of the Serengeti and fitted them to our vibrating football table.  Nick, Alyssa and Lais then took several pictures from above the table, pretending the camera was a plane flying over the ground below.  They then used Autostitch, a program we used last year to fit microscope pictures together, to create a single bigger picture of the whole table:

With that job done we took pictures of Nick and stitched them together into a single bigger picture that I'm calling Nickenstein (this week's word).

The ability to put together small pictures into one big one will help us take closeup picture of animals and put them together into a picture of the whole area they cover.

Also last week we put together a list of jobs that needed to be done for our project and they included:
a) Fly the drone
b) Take pictures
c) Fit the pictures together
d) Train the computer to recognize the pictures
e) Count the animals in the pictures
f) Get pictures of model animals

You each voted for the top two things you might want to do and based on those votes we matched people to jobs.  One thing we discovered since last week is that if you want to fly a drone for anything but the fun of it (and doing research in a school doesn't count as fun even if it is) then you have to be 18 years old.  What that means is that flying the drone over a farm to take pictures of animals for our project can only be done by someone who's 18 or older.  On the other hand, you can all fly the drone for fun, so that's what we're going to do.  Let's hope for good weather at the end of the week!

Back to the jobs.  With flying the drone for research not one of the choices any more, we divided things up as follows:
a) Fly the drone for fun: Everybody
b) Take pictures: Neshaya and Lais
c) Fit the pictures together: Lily and Lais
d) Train computer: Lily, Alyssa and Olivia
e) Count animals: Olivia and Hannah
f) Get pictures of model animals: Nick, Tara and Macy

Also, Alyssa volunteered to do another important task

g) Investigate regulations around flying drones: Alyssa

As we mentioned last week, one of the researchers Olivia emailed answered her back and was super helpful.  He said:

Dear Olivia and the comet warriors,

Thanks for your email - it's great that you're trying to solve this problem. I put a folder in dropbox with some images from the wildebeest survey. The link to the folder is here (let me know if this doesn't work) - 

https://www.dropbox.com/sh/0r9dp6kmp667mmd/AAB0rBmKP2Tvz7HqpjHXZQbra?dl=0

There's also a blog article about how they perform the survey here - 

https://fzs.org/en/projects/serengeti-conservation/news-serengeti/count-wildebeest-serengeti-ecosystem/

The person who wrote that blog is Bryna Griffin, her email is bryna.griffin@fzs.org, and she might be able to provide you with more images of different animals and will probably be really interested in your research.

I should warn you I think what you're trying to do will be difficult. If you look at Fig. 2B in my paper you'll see that even people struggle to accurately count the wildebeest in these images! In my opinion the best way to improve the process is to focus on getting better information about the shape of the animal. You could do this by using a stereo camera or another technique known as structure from motion (https://en.wikipedia.org/wiki/Structure_from_motion). 

We've been trying to do this with a drone and testing it with cows too - I put some images from our tests in the dropbox folder. There's two images of cows taken at slightly different angles (im1.png and im2.png) and the height.png image shows the height of the cows by calculating the difference in movement of the pixels. 

I hope this helps with your project but feel free to ask me any more questions

Good luck

Please take a look at Bryna's blog post on counting wildebeest (https://fzs.org/en/projects/serengeti-conservation/news-serengeti/count-wildebeest-serengeti-ecosystem/) and see what questions we might have for her.