Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion Dockerfile.backend
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ RUN LLAMA_LOCAL_ZIP="dependencies/llama.cpp.zip" \
&& cd llama.cpp \
&& mkdir -p build && cd build \
&& cmake .. \
&& cmake --build . --config Release \
&& cmake --build . --config Release -j\
&& if [ ! -f "bin/llama-server" ]; then \
echo "Build failed: llama-server executable not found" && exit 1; \
else \
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,7 @@ For data synthesis, we utilized [GraphRAG](https://github.com/microsoft/graphrag

For model deployment, we utilized [llama.cpp](https://github.com/ggml-org/llama.cpp), which provides efficient inference capabilities.

Our base models primarily come from the [Qwen2.5](https://huggingface.co/Qwen) series.
Our base models primarily come from the [Qwen](https://huggingface.co/Qwen) series.

We also want to extend our sincere gratitude to all users who have experienced Second Me. We recognize that there is significant room for optimization throughout the entire pipeline, and we are fully committed to iterative improvements to ensure everyone can enjoy the best possible experience locally.

Expand Down
2 changes: 1 addition & 1 deletion README_ja.md
Original file line number Diff line number Diff line change
Expand Up @@ -198,7 +198,7 @@ Made with [contrib.rocks](https://contrib.rocks).

モデルのデプロイには、効率的な推論機能を提供する[llama.cpp](https://github.com/ggml-org/llama.cpp)を使用しました。

私たちのベースモデルは主に[Qwen2.5](https://huggingface.co/Qwen)シリーズから来ています。
私たちのベースモデルは主に[Qwen](https://huggingface.co/Qwen)シリーズから来ています。

また、Second Meを体験してくれたすべてのユーザーに心から感謝します。パイプライン全体で最適化の余地が大いにあることを認識しており、皆さんがローカルで最高の体験を楽しめるようにするために、継続的な改善に全力を尽くします。

Expand Down
Binary file modified dependencies/llama.cpp.zip
Binary file not shown.
2 changes: 1 addition & 1 deletion docs/Custom Model Config(Ollama).md
Original file line number Diff line number Diff line change
Expand Up @@ -84,7 +84,7 @@ EMBEDDING_MAX_TEXT_LENGTH=embedding_model_context_length

```
Chat:
Model Name: qwen2.5:0.5b
Model Name: qwen2.5:0.6b
API Key: ollama
API Endpoint: http://127.0.0.1:11434/v1

Expand Down
7 changes: 5 additions & 2 deletions lpm_frontend/src/app/dashboard/playground/chat/page.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -47,12 +47,14 @@ export default function PlaygroundChat() {
const [activeSessionId, setActiveSessionId] = useState<string | null>(null);
const [messages, setMessages] = useState<Message[]>([]);
const [modelType, setModelType] = useState<ModelType | undefined>(undefined);
const [modelName, setModelName] = useState<string>('');

const originPrompt = useMemo(() => {
const name = loadInfo?.name || 'user';
const isQwen3 = modelName.toLowerCase().includes('qwen3');

if (modelType === 'chat') {
return `You are ${name}'s "Second Me", which is a personalized AI created by ${name}. You can help ${name} answer questions based on your understanding of ${name}'s background information and past records.`;
return `You are ${name}'s "Second Me", which is a personalized AI created by ${name}. You can help ${name} answer questions based on your understanding of ${name}'s background information and past records.${isQwen3 ? ' /no_think' : ''}`;
}

if (modelType === 'thinking') {
Expand All @@ -76,7 +78,7 @@ export default function PlaygroundChat() {
}

return '';
}, [loadInfo, modelType]);
}, [loadInfo, modelType, modelName]);
const originSettings = useMemo(() => {
return {
enableL0Retrieval: true,
Expand Down Expand Up @@ -110,6 +112,7 @@ export default function PlaygroundChat() {

localStorage.setItem('trainingParams', JSON.stringify(data));
setModelType(data.is_cot ? 'thinking' : 'chat');
setModelName(data.model_name || '');
} else {
throw new Error(res.data.message);
}
Expand Down
25 changes: 21 additions & 4 deletions lpm_frontend/src/app/dashboard/train/training/page.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -48,21 +48,38 @@ interface TrainingDetail {
}

const baseModelOptions = [
{
value: 'Qwen3-0.6B',
label: 'Qwen3-0.6B (8GB+ RAM Recommended)'
},
{
value: 'Qwen3-1.7B',
label: 'Qwen3-1.7B (16GB+ RAM Recommended)'
},
{
value: 'Qwen3-4B',
label: 'Qwen3-4B (32GB+ RAM Recommended)'
},
{
value: 'Qwen3-8B',
label: 'Qwen3-8B (64GB+ RAM Recommended)'
},
// Qwen2.5 models
{
value: 'Qwen2.5-0.5B-Instruct',
label: 'Qwen2.5-0.5B-Instruct (8GB+ RAM Recommended)'
label: 'Qwen2.5-0.5B (8GB+ RAM Recommended)'
},
{
value: 'Qwen2.5-1.5B-Instruct',
label: 'Qwen2.5-1.5B-Instruct (16GB+ RAM Recommended)'
label: 'Qwen2.5-1.5B (16GB+ RAM Recommended)'
},
{
value: 'Qwen2.5-3B-Instruct',
label: 'Qwen2.5-3B-Instruct (32GB+ RAM Recommended)'
label: 'Qwen2.5-3B (32GB+ RAM Recommended)'
},
{
value: 'Qwen2.5-7B-Instruct',
label: 'Qwen2.5-7B-Instruct (64GB+ RAM Recommended)'
label: 'Qwen2.5-7B (64GB+ RAM Recommended)'
}
];

Expand Down
2 changes: 1 addition & 1 deletion lpm_frontend/src/store/useTrainingStore.ts
Original file line number Diff line number Diff line change
Expand Up @@ -151,7 +151,7 @@ export const useTrainingStore = create<ModelState>((set, get) => ({

try {
const res = await getTrainProgress({
model_name: config.model_name || 'Qwen2.5-0.5B-Instruct'
model_name: config.model_name || 'Qwen3-0.6B'
});

if (res.data.code === 0) {
Expand Down
Loading