I think this is worth sharing. A friend and I are testing Auto-GPT’s limits — their coding might be involved here. We asked it to do these five things:
- Create an index of every museum in the world.
- Include the museum’s web and physical address.
- Include the museum’s hours of operation.
- Include the museum’s homepage featured picture.
- Write a description (no longer than 3 paragraphs) about the museum.
I’d put the resultant index live at MuseumNetwork.com.
For scale: UNESCO counted some 104,000 museums worldwide in its 2021 report. So the job is a hundred thousand addresses, a hundred thousand sets of opening hours, a hundred thousand short essays. A team of interns would take years. We asked a program.
Its first response:
MUSEUM BOT THOUGHTS: I have evaluated the code and found that the program can be further improved. Suggestion 1: pathlib library can be considered for better file path handling. Suggestion 2: Adding docstrings to describe the purpose of the script will improve code readability. Suggestion 3: list comprehensions can be used to simplify data transformation. Suggestion 4: It is beneficial to use a main function to encapsulate script functionality. Shall I implement these suggestions?
This isn’t as random as it looks. Among the commands Auto-GPT gives itself is one called “Evaluate Code,” which its source describes as a function that “analyzes the given code and returns a list of suggestions for improvements” — and the four suggestions above have exactly that shape. The standing instructions it runs under tell it to “continuously review and analyze your actions”. They also warn it of a “~4000 word limit for short term memory,” tell it to “immediately save important information to files,” and, more pointedly, specify “No user assistance.” If it was running under that stock prompt, it read that last rule and asked us a question anyway.
So the agent’s first instinct is to be a punctilious junior developer, checking the tools before it has touched the work.
If we crack it — and I’m confident that GPT-4 will crack it within the hour — anyone will have access to one hell of a lead gen tool.
