https://lms.onnocenter.or.id/wiki/index.php?action=history&feed=atom&title=AWS%3A_membuat_RAG_sederhana
AWS: membuat RAG sederhana - Revision history
2026-04-19T18:56:40Z
Revision history for this page on the wiki
MediaWiki 1.45.1
https://lms.onnocenter.or.id/wiki/index.php?title=AWS:_membuat_RAG_sederhana&diff=71298&oldid=prev
Unknown user: /* Pranala Menarik */
2024-12-03T03:58:49Z
<p><span class="autocomment">Pranala Menarik</span></p>
<table style="background-color: #fff; color: #202122;" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 03:58, 3 December 2024</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l66">Line 66:</td>
<td colspan="2" class="diff-lineno">Line 66:</td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>==Pranala Menarik==</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>==Pranala Menarik==</div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br></td></tr>
<tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* [[Cloud Computing]]</ins></div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* [[AWS]]</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* [[AWS]]</div></td></tr>
</table>
Unknown user
https://lms.onnocenter.or.id/wiki/index.php?title=AWS:_membuat_RAG_sederhana&diff=71297&oldid=prev
Unknown user: /* Arsitektur Sederhana: */
2024-12-03T03:56:32Z
<p><span class="autocomment">Arsitektur Sederhana:</span></p>
<table style="background-color: #fff; color: #202122;" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 03:56, 3 December 2024</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l62">Line 62:</td>
<td colspan="2" class="diff-lineno">Line 62:</td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div># '''API Access:''' API Gateway</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div># '''API Access:''' API Gateway</div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div># '''Monitoring:''' CloudWatch</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div># '''Monitoring:''' CloudWatch</div></td></tr>
<tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr>
<tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr>
<tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">==Pranala Menarik==</ins></div></td></tr>
<tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr>
<tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* [[AWS]]</ins></div></td></tr>
</table>
Unknown user
https://lms.onnocenter.or.id/wiki/index.php?title=AWS:_membuat_RAG_sederhana&diff=71295&oldid=prev
Unknown user: /* 6. Buat API untuk Konsumsi */
2024-12-03T03:54:15Z
<p><span class="autocomment">6. Buat API untuk Konsumsi</span></p>
<table style="background-color: #fff; color: #202122;" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 03:54, 3 December 2024</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l43">Line 43:</td>
<td colspan="2" class="diff-lineno">Line 43:</td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>** Endpoint ini menerima query, memproses pipeline retrieval dan generation, lalu mengembalikan jawaban.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>** Endpoint ini menerima query, memproses pipeline retrieval dan generation, lalu mengembalikan jawaban.</div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br></td></tr>
<tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>== 7. '''Monitoring dan Optimasi'''</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>== 7. '''Monitoring dan Optimasi'''<ins style="font-weight: bold; text-decoration: none;">==</ins></div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* '''AWS CloudWatch:''' </div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* '''AWS CloudWatch:''' </div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>** Pantau performa Lambda, SageMaker, dan OpenSearch untuk memastikan pipeline berjalan lancar.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>** Pantau performa Lambda, SageMaker, dan OpenSearch untuk memastikan pipeline berjalan lancar.</div></td></tr>
</table>
Unknown user
https://lms.onnocenter.or.id/wiki/index.php?title=AWS:_membuat_RAG_sederhana&diff=71294&oldid=prev
Unknown user: Created page with "Berikut adalah langkah-langkah sederhana untuk membuat '''RAG (Retrieval-Augmented Generation)''' di AWS: ==1. '''Persiapan Data'''== * '''Kumpulkan Data:''' Siapkan dokumen..."
2024-12-03T03:53:51Z
<p>Created page with "Berikut adalah langkah-langkah sederhana untuk membuat '''RAG (Retrieval-Augmented Generation)''' di AWS: ==1. '''Persiapan Data'''== * '''Kumpulkan Data:''' Siapkan dokumen..."</p>
<p><b>New page</b></p><div>Berikut adalah langkah-langkah sederhana untuk membuat '''RAG (Retrieval-Augmented Generation)''' di AWS:<br />
<br />
==1. '''Persiapan Data'''==<br />
* '''Kumpulkan Data:''' Siapkan dokumen atau sumber data yang ingin digunakan sebagai basis pengetahuan. Data ini dapat berupa file teks, PDF, atau database.<br />
* '''Format Data:''' Pastikan data dalam format yang mudah diakses (misalnya, CSV, JSON, atau dokumen teks).<br />
<br />
<br />
==2. '''Penyimpanan Data di AWS'''==<br />
* '''Gunakan Amazon S3:'''<br />
** Buat bucket di Amazon S3 untuk menyimpan data.<br />
** Upload data yang sudah disiapkan ke bucket tersebut.<br />
* '''Opsional - Elasticsearch:''' Jika ingin melakukan pencarian yang lebih kompleks, gunakan Amazon OpenSearch (sebelumnya Elasticsearch).<br />
<br />
<br />
==3. '''Proses Data untuk Retrieval'''==<br />
* '''Gunakan AWS Lambda:'''<br />
** Buat fungsi AWS Lambda untuk memproses data yang diunggah. Misalnya, memecah dokumen besar menjadi potongan-potongan kecil untuk mempermudah pencarian.<br />
** Simpan potongan data ini kembali ke S3 atau index ke OpenSearch.<br />
* '''Gunakan AWS Glue (Opsional):'''<br />
** Jika data dalam jumlah besar, gunakan AWS Glue untuk ETL (Extract, Transform, Load) sebelum disimpan atau diindeks.<br />
<br />
==4. '''Buat Sistem Retrieval'''==<br />
* '''Integrasi OpenSearch:'''<br />
** Index data ke Amazon OpenSearch.<br />
** Buat query API untuk mengambil dokumen relevan berdasarkan input pengguna.<br />
* '''Alternatif dengan S3:'''<br />
** Jika hanya menggunakan S3, buat Lambda function yang memproses pencarian dokumen secara manual.<br />
<br />
==5. '''Integrasi Model Generatif'''==<br />
* '''Deploy Model di SageMaker:'''<br />
** Gunakan Amazon SageMaker untuk melatih atau menghosting model generatif seperti GPT atau BLOOM.<br />
** Alternatif: Gunakan API dari penyedia layanan seperti OpenAI.<br />
* '''Integrasi Retrieval dan Generation:'''<br />
** Buat pipeline menggunakan Lambda atau aplikasi backend (misalnya, menggunakan AWS API Gateway) untuk:<br />
*** Mengirim query ke sistem retrieval.<br />
*** Menggabungkan data hasil retrieval dengan input pengguna.<br />
*** Mengirimkan input gabungan ke model generatif.<br />
<br />
<br />
== 6. '''Buat API untuk Konsumsi'''==<br />
* '''Gunakan AWS API Gateway:'''<br />
** Buat API endpoint untuk menghubungkan pengguna dengan pipeline RAG.<br />
** Endpoint ini menerima query, memproses pipeline retrieval dan generation, lalu mengembalikan jawaban.<br />
<br />
== 7. '''Monitoring dan Optimasi'''<br />
* '''AWS CloudWatch:''' <br />
** Pantau performa Lambda, SageMaker, dan OpenSearch untuk memastikan pipeline berjalan lancar.<br />
* '''AWS X-Ray:''' <br />
** Gunakan untuk tracing request dan debugging jika ada masalah dalam alur data.<br />
<br />
== 8. '''Pengujian dan Deployment'''==<br />
* '''Uji Sistem:'''<br />
** Pastikan sistem dapat menangani berbagai jenis query dan menghasilkan respons yang relevan.<br />
* '''Deploy dengan AWS Elastic Beanstalk atau ECS:''' <br />
** Jika membutuhkan aplikasi backend tambahan, gunakan Elastic Beanstalk atau ECS untuk deployment.<br />
<br />
== Arsitektur Sederhana:==<br />
<br />
# '''Data Storage:''' S3/OpenSearch<br />
# '''Data Processing:''' AWS Lambda<br />
# '''Model Hosting:''' SageMaker atau API eksternal<br />
# '''API Access:''' API Gateway<br />
# '''Monitoring:''' CloudWatch</div>
Unknown user