Skip to content

Commit 396e789

Browse files
al3xneal3xne
committed
ai-services-update
updated files for consistency
1 parent c362c1f commit 396e789

File tree

5 files changed

+204
-160
lines changed

5 files changed

+204
-160
lines changed

‎ai-and-app-modernisation/ai-services/generative-ai-service/speech-genai/README.md

Lines changed: 12 additions & 76 deletions
Original file line numberDiff line numberDiff line change
@@ -1,85 +1,21 @@
1-
# Integrate OCI AI Speech Service and Generative AI Summarization in Visual Builder
2-
3-
# Introduction
4-
5-
OCI Speech is an AI service that applies automatic speech recognition technology to transform audio-based content into text. Generative AI, The Large Language Model (LLM) analyzes the text input and can generate, summarize, transform, and extract information. Using these AI capabilities, we built a low code application- “Integrate OCI AI Speech Service and Generative AI Summarization in Visual Builder " to invoke AI Speech REST API to convert audio files into text and then further invoke the Generative AI REST API to Summarize it.
1+
# Transcribe and summarize speech to text
2+
3+
OCI Speech is an AI service that applies automatic speech recognition technology to transform audio-based content into text. Generative AI, The Large Language Model (LLM) analyzes the text input and can generate, summarize, transform, and extract information. Using these AI capabilities, we built a low code application- “Integrate OCI AI Speech Service and Generative AI Service for Summarization in Visual Builder " to invoke AI Speech REST API to convert audio files into text and then further invoke the Generative AI REST API to Summarize it.
64

75
Reviewed: 20.02.2024
8-
9-
<img src="./files/AISpeechGenAISummary.png"></img>
10-
11-
# Prerequisites
12-
13-
Before getting started, make sure you have access to these services:
14-
15-
- Oracle Speech Service
16-
- Oracle Generative AI Service
17-
- Oracle Visual Builder Cloud Service
18-
- Oracle Visual Builder Service Connection
19-
20-
# AI Speech and OCI Generative AI Service Integration Architecture
21-
22-
1. AI Speech App using VBCS
23-
24-
- Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
25-
26-
2. Transcriptions with OCI AI Speech Service:
27-
- Speech harnesses the power of spoken language enabling you to easily convert media files containing human speech into highly exact text transcriptions.
28-
- Produces accurate and easy-to-use JSON and SubRip Subtitle (SRT) files written directly to the Object Storage bucket you choose.
29-
30-
3. Integration with OCI Generative AI Service:
31-
- The transcriptions (text) are sent to the OCI Generative AI Service for text summarization.
32-
33-
4. Integration with OCI AI Vision and OCI Generative AI Service using Visual Builder Service Endpoint:
34-
- Build a Service Connection Endpoint option is used to integrate the VBCS app and OCI Object Storage, OCI AI Speech Service, and Generative AI Summarization.
35-
36-
5. Summarization Process:
37-
- OCI Generative AI Service generates text using the keywords received from OCI Speech service, to create a concise summary of the audio or video.
38-
39-
40-
<img src="./files/AISpeechSummaryAppArch.svg"></img>
41-
42-
# Application Flow in Detail (VBCS, OCI Speech, OCI Generative AI Service)
43-
44-
In this application, the drag-and-drop component in VBCS allows the user to drop the audio or video.
45-
- Create a Service Endpoint connection in Visual Builder to handle the communication between Visual Builder and OCI Speech Service.
46-
- Pass the selected audio or video from Visual Builder to OCI Speech Service to convert it into text.
47-
- OCI Speech Service analyzes the media (audio or video) file and converts it into text.
48-
- The OCI Speech Service returns the transcription to the AI Speech Service Endpoint and returns the results to the Visual Builder app.
49-
- The transcription further passes to the Generative AI Service Endpoint and returns the Summarization results to the Visual Builder app.
50-
51-
User (Visual Builder) --> (Drag and Drop File) --> |Media File (adudio or video) --> (Service Endpoint) --> |OCI Speech Service| --> |Speech to Text| --> (Service Endpoint) --> |Result| --> (Visual Builder) --> (Gen AI Service Endpoint) --> |Result| --> (Visual Builder)
52-
53-
<img src="./files/AISpeechEngine.png"></img>
54-
55-
# Service Endpoint call - Invoke OCI Object Storage
56-
57-
uploadfile - /n/{namespaceName}/b/{bucketName}/o/{objectName}
58-
getObject - /n/{namespaceName}/b/{bucketName}/o/{outputFolderName}/{outputObjectName}
59-
60-
61-
# Service Endpoint call - Invoke AI Speech Service
62-
63-
create transcription - /transcriptionJobs
64-
get transcription - transcriptionJobs/{transcriptionJobId}
65-
66-
# Service Endpoint call - Invoke Generative AI Service
67-
68-
create summary - /20231130/actions/summarizeText
69-
70-
71-
# Conclusion
72-
73-
In this article, we've covered how to utilize Oracle AI Speech Service features to provide a transription and summarize using Generative AI service.
74-
75-
Feel free to modify and expand upon this template according to your specific use case and preferences.
76-
77-
6+
7+
# When to use this asset?
8+
9+
See the README document in the /files folder.
10+
11+
# How to use this asset?
12+
13+
See the README document in the /files folder.
14+
7815
# License
7916

8017
Copyright (c) 2024 Oracle and/or its affiliates.
8118

8219
Licensed under the Universal Permissive License (UPL), Version 1.0.
8320

8421
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
85-

‎ai-and-app-modernisation/ai-services/generative-ai-service/speech-genai/files/README.md

Lines changed: 85 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,85 @@
1+
# Integrate OCI AI Speech Service and Generative AI Summarization in Visual Builder
2+
3+
# Introduction
4+
5+
OCI Speech is an AI service that applies automatic speech recognition technology to transform audio-based content into text. Generative AI, The Large Language Model (LLM) analyzes the text input and can generate, summarize, transform, and extract information. Using these AI capabilities, we built a low code application- “Integrate OCI AI Speech Service and Generative AI Summarization in Visual Builder " to invoke AI Speech REST API to convert audio files into text and then further invoke the Generative AI REST API to Summarize it.
6+
7+
Reviewed: 20.02.2024
8+
9+
<img src="./files/AISpeechGenAISummary.png"></img>
10+
11+
# Prerequisites
12+
13+
Before getting started, make sure you have access to these services:
14+
15+
- Oracle Speech Service
16+
- Oracle Generative AI Service
17+
- Oracle Visual Builder Cloud Service
18+
- Oracle Visual Builder Service Connection
19+
20+
# AI Speech and OCI Generative AI Service Integration Architecture
21+
22+
1. AI Speech App using VBCS
23+
24+
- Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
25+
26+
2. Transcriptions with OCI AI Speech Service:
27+
- Speech harnesses the power of spoken language enabling you to easily convert media files containing human speech into highly exact text transcriptions.
28+
- Produces accurate and easy-to-use JSON and SubRip Subtitle (SRT) files written directly to the Object Storage bucket you choose.
29+
30+
3. Integration with OCI Generative AI Service:
31+
- The transcriptions (text) are sent to the OCI Generative AI Service for text summarization.
32+
33+
4. Integration with OCI AI Vision and OCI Generative AI Service using Visual Builder Service Endpoint:
34+
- Build a Service Connection Endpoint option is used to integrate the VBCS app and OCI Object Storage, OCI AI Speech Service, and Generative AI Summarization.
35+
36+
5. Summarization Process:
37+
- OCI Generative AI Service generates text using the keywords received from OCI Speech service, to create a concise summary of the audio or video.
38+
39+
40+
<img src="./files/AISpeechSummaryAppArch.svg"></img>
41+
42+
# Application Flow in Detail (VBCS, OCI Speech, OCI Generative AI Service)
43+
44+
In this application, the drag-and-drop component in VBCS allows the user to drop the audio or video.
45+
- Create a Service Endpoint connection in Visual Builder to handle the communication between Visual Builder and OCI Speech Service.
46+
- Pass the selected audio or video from Visual Builder to OCI Speech Service to convert it into text.
47+
- OCI Speech Service analyzes the media (audio or video) file and converts it into text.
48+
- The OCI Speech Service returns the transcription to the AI Speech Service Endpoint and returns the results to the Visual Builder app.
49+
- The transcription further passes to the Generative AI Service Endpoint and returns the Summarization results to the Visual Builder app.
50+
51+
User (Visual Builder) --> (Drag and Drop File) --> |Media File (adudio or video) --> (Service Endpoint) --> |OCI Speech Service| --> |Speech to Text| --> (Service Endpoint) --> |Result| --> (Visual Builder) --> (Gen AI Service Endpoint) --> |Result| --> (Visual Builder)
52+
53+
<img src="./files/AISpeechEngine.png"></img>
54+
55+
# Service Endpoint call - Invoke OCI Object Storage
56+
57+
uploadfile - /n/{namespaceName}/b/{bucketName}/o/{objectName}
58+
getObject - /n/{namespaceName}/b/{bucketName}/o/{outputFolderName}/{outputObjectName}
59+
60+
61+
# Service Endpoint call - Invoke AI Speech Service
62+
63+
create transcription - /transcriptionJobs
64+
get transcription - transcriptionJobs/{transcriptionJobId}
65+
66+
# Service Endpoint call - Invoke Generative AI Service
67+
68+
create summary - /20231130/actions/summarizeText
69+
70+
71+
# Conclusion
72+
73+
In this article, we've covered how to utilize Oracle AI Speech Service features to provide a transription and summarize using Generative AI service.
74+
75+
Feel free to modify and expand upon this template according to your specific use case and preferences.
76+
77+
78+
# License
79+
80+
Copyright (c) 2024 Oracle and/or its affiliates.
81+
82+
Licensed under the Universal Permissive License (UPL), Version 1.0.
83+
84+
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
85+

‎ai-and-app-modernisation/ai-services/generative-ai-service/summarize-genai/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@ Text summarization, a core NLP task, unlocks the ability to distill lengthy cont
44

55
In this article, we'll delve into the creation of a powerful document summarization solution leveraging Oracle Generative AI. Through the integration of Oracle Gen AI's advanced capabilities with cutting-edge technologies such as langchain. This codebase empowers users to effortlessly summarize extensive documents, harnessing the power of Oracle Generative AI Service.
66

7+
Reviewed: 11.03.2024
8+
79
<img src="./files/docSummarize.png">
810
</img>
911

‎ai-and-app-modernisation/ai-services/generative-ai-service/vision-genai/README.md

Lines changed: 12 additions & 84 deletions
Original file line numberDiff line numberDiff line change
@@ -1,95 +1,23 @@
11
# Describe an image using OCI AI Vision Service and OCI Generative AI Service
2-
3-
# Introduction
2+
43
In this article, we'll explore how to describe an image using OCI AI Vision Service and OCI Generative AI Service.
54
The application is developed using Oracle VBCS, OIC, OCI AI Vision service, and OCI Generative AI Service.
6-
This integrated approach combines the strength of OCI AI Vision and OCI Generative AI Service, allowing for efficient and insightful summarization of image content.
7-
8-
9-
Reviewed: 21.02.2024
10-
11-
<img src="./files/AIVisionApp.jpg"></img>
12-
13-
14-
# Prerequisites
15-
16-
Before getting started, make sure you have access to these services:
17-
18-
- Oracle Generative AI Service
19-
- Oracle Vision Service
20-
- Oracle Visual Builder Cloud Service
21-
- Oracle Integration Cloud
22-
23-
# AI Vision and OCI Generative AI Service Integration Architecture
24-
25-
1. AI Vision App using VBCS
26-
- Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
27-
28-
2. Image Analysis with OCI AI Vision Service:
29-
- The AI Vision service is employed to analyze images.
30-
- It identifies objects within the image by using advanced computer vision algorithms.
31-
32-
3. Integration with OCI Generative AI Service:
33-
- The extracted object keywords are sent to the OCI Generative AI Service
34-
35-
4. Integration with OCI AI Vision and OCI Generative AI Service using OIC:
36-
- Oracle Integration Cloud integrates the VBCS app and OCI AI Services.
37-
38-
5. Summarization Process:
39-
- OCI Generative AI Service generates text using the keywords received from OCI Vision service, to create a concise summary of the image.
40-
41-
<img src="./files/AIVisionAppArch.svg"></img>
42-
43-
# Application Flow in Detail (VBCS, OIC, OCI Vision, OCI Generative AI Service)
44-
45-
In this application,
46-
- The File Picker action in VBCS allows the user to select the image.
47-
- Create an integration process in Oracle Integration Cloud (OIC) to handle the communication between VBCS and OCI Vision Service.
48-
- Pass the selected image from VBCS to OCI Vision Service to analyze the image.
49-
- OCI Vision Service analyzes the image and identifies objects within it.
50-
- The OCI Vision Service returns the detected objects (keywords) to the OIC integration process and returns the results to VBCS.
51-
52-
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Objects| --> (OIC) --> |Result| --> (VBCS)
53-
54-
<img src="./files/VBCS_Vision.jpg">
55-
</img>
56-
57-
OIC call - Invoke OCI Vision Service
58-
Endpoint - /actions/analyzeImage
59-
60-
<img src="./files/OIC_VisionService.jpg">
61-
</img>
62-
63-
- User clicks the "Generate" button in the app to initiate the summary generation.
64-
- Configure the OIC integration process to invoke the GenAI service.
65-
- Pass the keywords returned by the OCI Vision Service along with any additional relevant information.
66-
- Generative AI Service processes the received keywords and generates a summary of the image content.
67-
68-
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Keywords| --> (OIC) --> | OCI Generative AI Service --> |Summary| --> (OIC) --> |Result| --> (VBCS)
69-
70-
<img src="./files/VBCS_GenerateSummary.jpg">
71-
</img>
72-
73-
OIC call - Invoke OCI Generative AI Service
74-
Endpoint - /20231130/actions/generatText
75-
<img src="./files/OIC_GenerateSummary.jpg">
76-
</img>
77-
78-
# Code
79-
VBCS app - ImageClassification-1.0.zip
80-
OIC Vision Integration - RESTVISION_01.00.0000.iar
81-
OIC Generate Summary - IMAGEDESCRIPTIONGENERATION_01.00.0000.iar
82-
83-
# Conclusion
84-
85-
In this article, we've covered how to utilize Oracle AI Vision Service features to provide a summary of an image using Generative AI service.
86-
Feel free to modify and expand upon this template according to your specific use case and preferences.
5+
This integrated approach combines the strength of OCI AI Vision and OCI Generative AI Service, allowing for efficient and insightful summarization of image content.
876

7+
Reviewed: 20.02.2024
8+
9+
# When to use this asset?
10+
11+
See the README document in the /files folder.
12+
13+
# How to use this asset?
14+
15+
See the README document in the /files folder.
16+
8817
# License
8918

9019
Copyright (c) 2024 Oracle and/or its affiliates.
9120

9221
Licensed under the Universal Permissive License (UPL), Version 1.0.
9322

9423
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
95-

‎ai-and-app-modernisation/ai-services/generative-ai-service/vision-genai/files/README.md

Lines changed: 93 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,93 @@
1+
# Describe an image using OCI AI Vision Service and OCI Generative AI Service
2+
3+
# Introduction
4+
In this article, we'll explore how to describe an image using OCI AI Vision Service and OCI Generative AI Service.
5+
The application is developed using Oracle VBCS, OIC, OCI AI Vision service, and OCI Generative AI Service.
6+
This integrated approach combines the strength of OCI AI Vision and OCI Generative AI Service, allowing for efficient and insightful summarization of image content.
7+
8+
9+
<img src="./files/AIVisionApp.jpg"></img>
10+
11+
12+
# Prerequisites
13+
14+
Before getting started, make sure you have access to these services:
15+
16+
- Oracle Generative AI Service
17+
- Oracle Vision Service
18+
- Oracle Visual Builder Cloud Service
19+
- Oracle Integration Cloud
20+
21+
# AI Vision and OCI Generative AI Service Integration Architecture
22+
23+
1. AI Vision App using VBCS
24+
- Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
25+
26+
2. Image Analysis with OCI AI Vision Service:
27+
- The AI Vision service is employed to analyze images.
28+
- It identifies objects within the image by using advanced computer vision algorithms.
29+
30+
3. Integration with OCI Generative AI Service:
31+
- The extracted object keywords are sent to the OCI Generative AI Service
32+
33+
4. Integration with OCI AI Vision and OCI Generative AI Service using OIC:
34+
- Oracle Integration Cloud integrates the VBCS app and OCI AI Services.
35+
36+
5. Summarization Process:
37+
- OCI Generative AI Service generates text using the keywords received from OCI Vision service, to create a concise summary of the image.
38+
39+
<img src="./files/AIVisionAppArch.svg"></img>
40+
41+
# Application Flow in Detail (VBCS, OIC, OCI Vision, OCI Generative AI Service)
42+
43+
In this application,
44+
- The File Picker action in VBCS allows the user to select the image.
45+
- Create an integration process in Oracle Integration Cloud (OIC) to handle the communication between VBCS and OCI Vision Service.
46+
- Pass the selected image from VBCS to OCI Vision Service to analyze the image.
47+
- OCI Vision Service analyzes the image and identifies objects within it.
48+
- The OCI Vision Service returns the detected objects (keywords) to the OIC integration process and returns the results to VBCS.
49+
50+
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Objects| --> (OIC) --> |Result| --> (VBCS)
51+
52+
<img src="./files/VBCS_Vision.jpg">
53+
</img>
54+
55+
OIC call - Invoke OCI Vision Service
56+
Endpoint - /actions/analyzeImage
57+
58+
<img src="./files/OIC_VisionService.jpg">
59+
</img>
60+
61+
- User clicks the "Generate" button in the app to initiate the summary generation.
62+
- Configure the OIC integration process to invoke the GenAI service.
63+
- Pass the keywords returned by the OCI Vision Service along with any additional relevant information.
64+
- Generative AI Service processes the received keywords and generates a summary of the image content.
65+
66+
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Keywords| --> (OIC) --> | OCI Generative AI Service --> |Summary| --> (OIC) --> |Result| --> (VBCS)
67+
68+
<img src="./files/VBCS_GenerateSummary.jpg">
69+
</img>
70+
71+
OIC call - Invoke OCI Generative AI Service
72+
Endpoint - /20231130/actions/generatText
73+
<img src="./files/OIC_GenerateSummary.jpg">
74+
</img>
75+
76+
# Code
77+
VBCS app - ImageClassification-1.0.zip
78+
OIC Vision Integration - RESTVISION_01.00.0000.iar
79+
OIC Generate Summary - IMAGEDESCRIPTIONGENERATION_01.00.0000.iar
80+
81+
# Conclusion
82+
83+
In this article, we've covered how to utilize Oracle AI Vision Service features to provide a summary of an image using Generative AI service.
84+
Feel free to modify and expand upon this template according to your specific use case and preferences.
85+
86+
# License
87+
88+
Copyright (c) 2024 Oracle and/or its affiliates.
89+
90+
Licensed under the Universal Permissive License (UPL), Version 1.0.
91+
92+
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
93+

0 commit comments

Comments
 (0)