Category Archives: Interesting Development

From Queries to Conversations: The Art of Training the Thread

Recently, literally last night, I was discussing LLMs with a couple of my friends and it became very obvious that we each had vastly different ideas / expectations of what they are.

They are not search engines, that was the one thing we all agreed. But past that we all had different ideas / definitions. And I am not even sure we all had a definition – I know now that I didn’t and I still don’t. So, this morning I did what I have been doing lately when I have a question that bothers me – I put it to a couple of my LLMs of choice Claude and chatGPT. The responses I got from them:

LLMs aren’t oracles or search engines, but rather language pattern prediction systems that can be remarkably helpful while still requiring human oversight.

ChatGPT – strong all-rounder, especially great at explanation, tone control, and multi-step reasoning.

Claude – excels at long-context thinking and “softer,” more reflective responses—Anthropic definitely trained it with a more careful tone.

Perplexity – the search-hybrid beast. Super fast, source-backed, very handy for staying close to the real-time web.

interesting, at least I thought it was. And while I am still searching for the definition I like where this is leading me.

Both claude and chatGPT actually asked what I thought of LLMs and how defined tham. And I responded to both and they both responded to my response. And it was over the interactive conversation that I thnk I got a better sense of what I was trying to ask and get to.

Even though they both suggested that I write something I intentionally did not ask them to write something for me, but chatGPT did suggest the title. Another interesting observation.

– manzoor

P.S. the title of this post was actually suggested by one of the LLMs (chatGPT) and they both suggested / implied that maybe I was going to write something.

Large Language Models

ChatGPT became publicly available in late 2022 and ever since there seems to have been a race in this AI domain. I have not really been really into the whole thing but am getting really interested.

A very high level timeline (will need to update / correct at some point)

2017 – some scientists at Google publish a paper, “Attention is all you need” proposing a new model called Transformer

2018 – GPT-1 with 117M Parameters

2019 – GPT-2 with 1.5B

2020 – GPT-3 175B

2022 – we have RLHF, Reinforcement Learning from Human Feedback, and ChatGPT

2023 – GPT-4 1T

2024 – GPT-4o

– manzoor

Apple M1

It’s been in the rumor mill for some time but finally in November 2020 Apple made the official announcement – Apple Introduced the M1 processor and the very first batch of hardware based on it.

Not exactly sure what all the advantages of the new chip is, but I do feel it is here to stay. And with that I went ahead and got myself a laptop running the new M1 processor. It’s a MacBook Air with 16 Gb of memory and 500 Gb of flash storage. My initial plan is to avoid the Rosetta Translation Environment – as long as I can. I am running into a few issues and am trying to find workarounds. We’ll see how far I get.

– manzoor

Ephemeral Social Networking

Fleets from twitter will be the most recent addition to a concept that first started with SnapChat. I must confess – I never quite understood the whole idea. But of course, I also don’t understand ever deleting / destroying / throwing away anything.

Of course things live out their “need” or “relevance”, i.e., the lives and then they go away naturally. That to me makes sense.

– manzoor

Preparing for macOS Mojave

I use my Mac for both work and personal reasons and I do prefer to be on the newest OS level. While I am pretty sure that most of my personal needs will be supported by the new macOS, I am not necessarily as confident of my professional needs. For some context, here is my “Dev Env Setup” that I follow / maintain.

  1. VirtualBox – https://www.virtualbox.org/ticket/17805

The following seem to be working properly, i.e., w/o any issues (so far).

  • Xcode v9.4.1
  • git v2.15.2
  • Viber
  • WhatsApp

– manzoor

Cryptocurrency

I have been paying more and more attention to both side of this “Cryptocurrency” – the technology (i.e., Blockchain) and the market (i.e., bitcoin).

But the market / bitcoin also has 2 sides – it’s application and the “market”.

Irrespective of all the various sides, I do feel the time has come to accept that this is something that we will be hearing more and more of and it will be something that we will use to do certain things.

Some examples of current goods / services I could pay for in Bitcoin if I wanted to.

DishNeworkBitcoinPayment

– manzoor

Apple AirPods

At $159 these are going to be the most expensive pair or head-phone thing I will have ever bought.

But I am excited about it. I only hope it switches from my various devices as well as they eluded to in the Apple Event.

I am a bit disappointed that these won’t be available till October 13th (and that they are going to be $159 for a pair).

– manzoor

  • What happens if I loose just one?
  • how to keep mine separated from my friends’?