Search This Blog

Monday 27 May 2024

Reflections on student research projects

I was supervising 7 Masters of AI / Masters of Data Science / Masters of Cybersecurity students this semester.  Reach out to me if you are looking for people with these skills and I'll introduce you; also, if you have small industry projects that need doing, there are cohorts from Macquarie and ANU next semester.

On Friday we had the final presentations from my students and the rest of the cohort. Observations:

  • Very few students trained their own computer vision models. Viet (one of my supervision students) was one of the few that did, and was quite successful. Instead, research in computer vision is now often asking "how can I prompt Claude/ChatGPT/Gemini able to get the right answer?" As Marco found, this is often not a trivial exercise, is vastly more inefficient than a trained model, and not necessarily all that accurate. Yet.
  • Explainability is a big deal. Both Viet and Himanshu looked at explaining the results of their models. Shout out to Himanshu for delivering his presentation in the dark (I don't know why the lights weren't working...) after racing to get there after his car broke down.
  • We don't know whether blockchains can coexist with quantum computers. The problem is obvious: RSA or ECC public keys are too easy for quantum computers to break. Lots of solutions have been proposed: Suyash, Proshanta and Pradyumn all found problems in the different solutions they looked at.
  • In research, ChatGPT wasn't all that popular: about a third of the cohort that used an LLM in their research used ChatGPT. Open source models like llama and mixtral were far more popular in academia than in business (that I have seen).
  • About 90% of projects didn't use LLMs at all in their research. They might have used it to clean up their writing or other "mundane" tasks, but it didn't play a part in the research process itself. I am going to try to track that over the next few years as I expect it will drop.
Reflecting on the reflections:
  • For $20/month, you can have access to all the necessary tools to do world-leading computer vision tasks. It has been a long time since the forefront of technology has been that accessible and that cheap anywhere in anything. Truly we live in wondrous times.
  • As we move into a (possibly) AGI+quantum world, being confident that you can trust complex systems will become much more important than building the thing itself.

Monday 20 May 2024

10 years of this blog

I started this blog 10 years ago.

The most popular post was at the start of the pandemic, where I wrote a detailed post How I teach Remotely I had been doing that for many years before the pandemic; I could have written it before any lockdowns started.

The next most popular post was Something funny is about to happen to prices which talked about some of the weird things that I predicted would happen as we started getting negative electricity prices. I assumed that Australia would develop industries that made use of nature's subsidy; but alas, Australian industry is too uncompetitive even if electricity is free-er than free.

After that, there were some posts about how to fix things in HP DataProtector. I think I was expecting the blog to be mostly about data protection: the first post was about HP's confusing line-up of overlapping backup products, and identifying when it was cheaper to go with one choice over the other. HP no longer have overlapping backup products -- they sold them all to Hewlett-Packard Enterprise Entco Microfocus OpenText who now has a confusing line-up of overlapping backup products (different ones). Those a

Anyway, it looks like what I should be writing about is extrapolations into the future of what I'm seeing happening now. That's good. I have started writing a book on what we should expect in the next 5 years in AI, so I'll post excerpts as I write it.