Is function calling the only way to do this? If the user account has some associated text, for example, historical medical files, is there a way to pass that text in such that the user could query "Write a short summary about my medical history?"
You can create a function calling, the parameter is the user_id or a fingerprint of the user for backend. then, get all data from your database, returned as a JSON object, then, you will get the result.
The prompt will looks like:
"""
you are a professional medical history recorder, write a short summary about the user's medical history, use tool_call when possible.
the current user_id is: abcd12345
"""
your tool_call description should be set clearly, looks like:
Comments
This is often called Function calling or tool use where you provide the LLM the ability to execute API calls to external tools.
Is function calling the only way to do this? If the user account has some associated text, for example, historical medical files, is there a way to pass that text in such that the user could query "Write a short summary about my medical history?"
You can create a function calling, the parameter is the user_id or a fingerprint of the user for backend. then, get all data from your database, returned as a JSON object, then, you will get the result.
The prompt will looks like:
""" you are a professional medical history recorder, write a short summary about the user's medical history, use tool_call when possible.
the current user_id is: abcd12345 """
your tool_call description should be set clearly, looks like:
""" get medical history by given user_id """