使用 Vision API 检测产品并生成广告文案¶
本文演示了如何使用 GPT-4 Vision API 和 Chat API 从产品图片中自动生成广告文案。这种方法对于营销和广告团队以及电子商务平台非常有用。
完整代码可在 GitHub 上找到。
构建模型¶
产品¶
对于 Product 模型，我们定义了一个类来表示从图片中提取的产品，并存储其名称、主要特点和描述。产品属性是根据图片内容动态确定的。
请注意，很容易向模型添加 验证器 和其他 Pydantic 特性，以确保数据有效且一致。
from pydantic import BaseModel, Field
from typing import List, Optional
class Product(BaseModel):
"""
Represents a product extracted from an image using AI.
The product attributes are dynamically determined based on the content
of the image and the AI's interpretation. This class serves as a structured
representation of the identified product characteristics.
"""
name: str = Field(
description="A generic name for the product.", example="Headphones"
)
key_features: Optional[List[str]] = Field(
description="A list of key features of the product that stand out.",
default=None,
)
description: Optional[str] = Field(
description="A description of the product.",
default=None,
)
# Can be customized and automatically generated
def generate_prompt(self):
prompt = f"Product: {self.name}\n"
if self.description:
prompt += f"Description: {self.description}\n"
if self.key_features:
prompt += f"Key Features: {', '.join(self.key_features)}\n"
return prompt
识别的产品¶
我们还定义了一个类，表示图片中识别的产品列表。我们还添加了一个错误标志和消息，以指示图片处理过程中是否发生错误。
from pydantic import BaseModel, Field
from typing import Optional, List
class IdentifiedProduct(BaseModel):
"""
Represents a list of products identified in the images.
"""
products: Optional[List[Product]] = Field(
description="A list of products identified by the AI.",
example=[
Product(
name="Headphones",
description="Wireless headphones with noise cancellation.",
key_features=["Wireless", "Noise Cancellation"],
)
],
default=None,
)
error: bool = Field(default=False)
message: Optional[str] = Field(default=None)
广告文案¶
最后，AdCopy 模型以结构化格式存储输出，包含标题和正文。
from pydantic import BaseModel, Field
class AdCopy(BaseModel):
"""
Represents a generated ad copy.
"""
headline: str = Field(
description="A short, catchy, and memorable headline for the given product. The headline should invoke curiosity and interest in the product.",
)
ad_copy: str = Field(
description="A long-form advertisement copy for the given product. This will be used in campaigns to promote the product with a persuasive message and a call-to-action with the objective of driving sales.",
)
name: str = Field(description="The name of the product being advertised.")
调用 API¶
产品检测¶
read_images 函数使用 OpenAI 的 Vision 模型处理图像 URL 列表，并识别每张图片中的产品。为此，我们利用 instructor 库对 OpenAI 客户端进行修补。
def read_images(image_urls: list[str]) -> IdentifiedProduct:
"""
Given a list of image URLs, identify the products in the images.
"""
logger.info(f"Identifying products in images... {len(image_urls)} images")
return client_image.chat.completions.create(
model="gpt-4o-mini",
response_model=IdentifiedProduct,
max_tokens=1024, # can be changed
temperature=0,
messages=[
{
"role": "user",
"content": [
{
"type": "text",
"text": "Identify products using the given images and generate key features for each product.",
},
*[
{"type": "image_url", "image_url": {"url": url}}
for url in image_urls
],
],
}
],
)
这为我们提供了所有图片中识别的产品列表。
生成广告文案¶
然后，我们可以使用 generate_ad_copy 函数为图片中识别的每个产品生成广告文案。
为两个不同的模型定义了两个客户端。这是因为 gpt-4-vision-preview 模型在响应格式上与 gpt-4-1106-preview 模型不兼容。
def generate_ad_copy(product: Product) -> AdCopy:
"""
Given a product, generate an ad copy for the product.
"""
logger.info(f"Generating ad copy for product: {product.name}")
return client_copy.chat.completions.create(
model="gpt-4o-mini",
response_model=AdCopy,
temperature=0.3,
messages=[
{
"role": "system",
"content": "You are an expert marketing assistant for all products. Your task is to generate an advertisement copy for a product using the name, description, and key features.",
},
{"role": "user", "content": product.generate_prompt()},
],
)
整合所有部分¶
最后，我们可以将所有部分整合到一个函数中，该函数接收图像 URL 列表，并为图片中识别的产品生成广告文案。完整的实现请参阅完整代码。
输入文件¶
输入文件目前是图像 URL 列表，但将其更改为任何所需格式都很容易。
https://contents.mediadecathlon.com/p1279823/9a1c59ad97a4084a346c014740ae4d3ff860ea70b485ee65f34017ff5e9ae5f7/recreational-ice-skates-fit-50-black.jpg?format=auto
https://contents.mediadecathlon.com/p1279822/a730505231dbd6747c14ee93e8f89e824d3fa2a5b885ec26de8d7feb5626638a/recreational-ice-skates-fit-50-black.jpg?format=auto
https://contents.mediadecathlon.com/p2329893/1ed75517602a5e00245b89ab6a1c6be6d8968a5a227c932b10599f857f3ed4cd/mens-hiking-leather-boots-sh-100-x-warm.jpg?format=auto
https://contents.mediadecathlon.com/p2047870/8712c55568dd9928c83b19c6a4067bf161811a469433dc89244f0ff96a50e3e9/men-s-winter-hiking-boots-sh-100-x-warm-grey.jpg?format=auto
展开查看输出
{
"products":
[
{
"name": "Ice Skates",
"key_features": [
"Lace-up closure",
"Durable blade",
"Ankle support"
],
"description": "A pair of ice skates with lace-up closure for secure fit, durable blade for ice skating, and reinforced ankle support."
},
{
"name": "Hiking Boots",
"key_features": [
"High-top design",
"Rugged outsole",
"Water-resistant"
],
"description": "Sturdy hiking boots featuring a high-top design for ankle support, rugged outsole for grip on uneven terrain, and water-resistant construction."
},
{
"name": "Winter Boots",
"key_features": [
"Insulated lining",
"Waterproof lower",
"Slip-resistant sole"
],
"description": "Warm winter boots with insulated lining for cold weather, waterproof lower section to keep feet dry, and a slip-resistant sole for stability."
}
],
"ad_copies": [
{
"headline": "Glide with Confidence - Discover the Perfect Ice Skates!",
"ad_copy": "Step onto the ice with poise and precision with our premium Ice Skates. Designed for both beginners and seasoned skaters, these skates offer a perfect blend of comfort and performance. The lace-up closure ensures a snug fit that keeps you stable as you carve through the ice. With a durable blade that withstands the test of time, you can focus on perfecting your moves rather than worrying about your equipment. The reinforced ankle support provides the necessary protection and aids in preventing injuries, allowing you to skate with peace of mind. Whether you're practicing your spins, jumps, or simply enjoying a leisurely glide across the rink, our Ice Skates are the ideal companion for your ice adventures. Lace up and get ready to experience the thrill of ice skating like never before!",
"name": "Ice Skates"
},
{
"headline": "Conquer Every Trail with Confidence!",
"ad_copy": "Embark on your next adventure with our top-of-the-line Hiking Boots! Designed for the trail-blazing spirits, these boots boast a high-top design that provides unparalleled ankle support to keep you steady on any path. The rugged outsole ensures a firm grip on the most uneven terrains, while the water-resistant construction keeps your feet dry as you traverse through streams and muddy trails. Whether you're a seasoned hiker or just starting out, our Hiking Boots are the perfect companion for your outdoor escapades. Lace up and step into the wild with confidence - your journey awaits!",
"name": "Hiking Boots"
},
{
"headline": "Conquer the Cold with Comfort!",
"ad_copy": "Step into the season with confidence in our Winter Boots, the ultimate ally against the chill. Designed for those who don't let the cold dictate their moves, these boots feature an insulated lining that wraps your feet in a warm embrace, ensuring that the biting cold is a worry of the past. But warmth isn't their only virtue. With a waterproof lower section, your feet will remain dry and cozy, come rain, snow, or slush. And let's not forget the slip-resistant sole that stands between you and the treacherous ice, offering stability and peace of mind with every step you take. Whether you're braving a blizzard or just nipping out for a coffee, our Winter Boots are your trusty companions, keeping you warm, dry, and upright. Don't let winter slow you down. Lace up and embrace the elements!",
"name": "Winter Boots"
}
]
}