Baseball: Object As Container

For my object I decided to use a baseball. At first thought I was reticent to use this because at first glance it doesn't seem to have too much personality. After all, the object is mass produced with the intent of being the same in every aspect. However, there's something about a game-used baseball that does give it plenty of personality. If you've ever caught a foul ball for example, there are scuffs where the bat has made contact that gives it a distinct feel. Each scuff builds to the creation of a memory of the moment in which the ball was caught. This isn't to mention the symbolic nature of a baseball itself. A fan of the game, upon seeing a baseball, instantly associates it with something much more than cork wrapped in yarn. Alex Zimmer and I wanted to use this as a jumping point.

Originally we had two ideas: imbue my object with a memory or augment a baseball scorecard. The latter was to be a backup option lest Vuforia's object scanner fail to work properly.  

Let me start by saying that it isn't so much a pain in the ass to use Vuforia's object scanning software, it's more of a pain in the ass getting on an Android Phone. Vuforia only allows this to be loaded on to Galaxy Note 6's and 7's. Luckily, work has a Galaxy 7 that I was able to borrow. After spending like 20 minutes trying to figure out how to get the SDK software onto the phone - I'm a lifelong Apple user - I went home to try to scan the baseball. After opening the software and wondering why it wasn't working I checked the documentation only to see that apparently a piece of paper is meant to accompany the scanned object. 

I went to school, printed the gray piece of paper and tried scanning with Alex. Our first scan was sort of successful as we gathered about 200+ points. We found we had some success once we tried to augment a cube onto the object but it was really inconsistent. Alex and I thought if perhaps we wrote something on the ball in permanent marker, this would give the object scanner more to work with. I got a brown sharpie and wrote "Home Run" on one side and "Dad and I" on the other. This scan revealed about 400+ markers and was a lot easier to pick up in Unity.


Now that we had the object scanned we knew we'd have success augmenting it the way we wanted. 

At every baseball game a fan walks away with a ball as a souvenir. Sometimes the ball was a foul, sometimes it was a home run, sometimes a player tosses it to someone. Either way a fan usually ends up cherishing this ball be it for the remainder of the game or for the remainder of their lives. Alex and I wanted to take the means in which the fan received the ball and make it a memory of the ball itself by augmenting it. 

Alex and I found the above clip - a very famous home run hit a few years ago - and made sure it was from a fan's perspective (we couldn't find one from the perspective of the fan who caught the ball) and augmented it on the ball. Having merely placed a plane with a video player on the ball wasn't enough though. We wanted to give the impression that the ball that we were augmenting had the memory that caused the fan to receive it inside of it. Almost like an egg or a ...pokeball. The final result is attached below. 

Magic Windows: David Bowie

"There's a Starman, Waiting in AR"

For this project, Scott Reitherman and I teamed up to create an "app" that we're actually really excited about. Both Scott and I are big into music; we collect vinyl, talk about album histories and enjoy introducing one another to new genres (Scott's more ambient and I'm more funk). We thought it would be cool to create an app that brought the stories of albums to life; one that gave the listener a greater sense of what went in to making a particular album. There's a small book series called 33 1/3 which tells the entire story of an album in a small 100ish page novella and I think we thought it would be cool to essentially turn one of those into an augmented reality experience that took place in and on the album that was being focused on.


I think it all started with Bowie. Scott approached me after class and said he had an idea involving augmenting vinyl. He mentioned maybe doing this with a Bowie album. Being a big fan of the Thin White Duke myself, I thought this was a great idea. I added that rather than just showing users random images from when the album was made it would be interesting to have those images tell a story in an of themselves. For example, if we did Bowie's last album, "Blackstar" it would be cool to have the augmented images slowly fade into death as the user advanced through the album.

Scott and I settled on an vinyl he owned that was called Ziggy Stardust: The Motion picture. We chose this album because the inside had separate images that we thought we be better to augment other images on.  Here is the final product (a correctly oriented video will be updated soon, just wanted to get this blog post up):

Unity Does Not Like Videos...

There were a lot of difficulties making this project all centering around adding video to Vuforia. While getting the proper scripts in place wasn't too difficult, getting the video to play along with the audio was an extremely laborious task that took up 90% of the projects time. The issue seemed to be with the codec and dimensionality of the videos. They all needed to be 640x360 and if they weren't the audio would play but not the video. When we tried re-orienting these videos in Premiere we would also have issues where the video wouldn't play (but the audio would) while holding your phone vertically, but would play properly while holding your phone horizontally.

We also ran into issues with how the video was uploaded in Unity. At first we thought it was ok to drag and drop the videos (mp4's) into the Streaming Assets folder but then we realized we couldn't make any adjustments to them. Then we tried uploading the videos into the assets folder which seemed to be the correct move, or so we thought. Turns out the video needed to be transcoded (thanks to Gabe for the help with this). After THAT was figured out, we still had some issues but after a bit more trouble shooting we got it to work.

Future Improvements

Scott and I spent so much time making sure the videos work and that we had the proper content that we weren't able to complete what I think is one of the more crucial elements of the project: additional story-telling. While the evolution of the augments follows a particular story, there are certainly subtleties that I want to imbue in the project that I think we could've done with more time/less technical issues. For example, I love the video on the cover, I love the story it tells; it's a perfect introduction. However, I wish it had smoke coming from the top of it to tie in the fire coming from the cover. I also wish the videos would get more frantic and cut in and out more to show Bowie losing his mind as his success increased. 

Overall though, I'm really pleased with what we got and I'm eager to take the next steps with this app as I think it could be an interesting, non-novelty-driven exploration of augmented reality. 

Projection Mapping

One of my favorite films of all time is 2001: A Space Odyssey. The notion of a prescient monolith delivered to earth by an evolved species is just of endless fascination to me. I thought it would be cool to explore this a bit further for my first projection map.

A famous line from the text is the final words Dave Bowman utters before he enters the monolith: "My god, it's full of stars."

I thought it would cool to utilize that period at the end of the sentence, using it as an entrance into the monolith.

Drawing isn't my forte

In an ideal world, the sketch featured above would take up an entire museum wall. The period at the end would be about 7 feet tall by 5 feet wide and the projection would be pointed at the period. (Man, as excited as I am about this projection, it sure does take the appeal out of it when you film it in your dinghy apartment.) That way, there's a sort of shock when the black period "opens up" and the user enters into the world of 2001. 


Overall, I'm pretty happy with how things turned out especially considering I'm still learning Unity. The most difficult technical aspects were making sure the video and door animations worked properly (I admittedly had some help with the Lynda tutorials for the latter). While I'm certainly underwhelmed by seeing the projection on a crappy speaker in my apartment, it makes me really excited to see what it would look like in a more ideal setting. Either way, it's made me very eager to explore the world of projection mapping a bit more.  

Get a Grip

As I mentioned in class, I’m a bit baseball obsessed. Considering the assignment was to create a .gif that represented you, I figured why not stick with what I’m passionate about.

Aside from working for Major League Baseball I also write/podcast for PitcherList, a site dedicated to everything about pitching. So my animated .gif is focused on just that: pitching. Specifically two grips commonly used in the sport: the four seam grip (featured first) and the cutter grip. Below that animated .gif are the two pitches being used.

Here is Marco Estrada’s Four Seam Fastball (first grip)


And here is Jon Lester’s cutter (second grip)