Mehrsprachige Bedienung und versionierte Aufgabenvarianten einführen

Übersetzungskataloge, getrennte Sprachpräferenzen und einen versionierten Aufgabenpilot ergänzen. Historische Aufgaben und Bewertungen bleiben erhalten; äquivalente Ansichten teilen Nachweise. Lokal mit Race-Tests und PostgreSQL, Vet, Web-Build, Bank-Audits und Browser-Fixtures geprüft. Dieser Stand dient als Ausgangspunkt für die anschließend beauftragte Zusammenführung zur Muttersprache.
This commit is contained in:
Eugenius Naumenko
2026-11-07 16:26:26 +00:00
parent 87684ba0fd
commit f3d42ee2b6
68 changed files with 3895 additions and 481 deletions
+30 -2
View File
@@ -5,7 +5,10 @@ synthetischen Mikrofonsignal: standardmäßig keine Mithörbedienung und kein
Mithörpfad; nach expliziter Freigabe über `enableMonitoring` zunächst ausgeschaltetes Mithören, Schalter und
Lautstärke während der Aufnahme, tatsächliche Signalpegel, unveränderte
WAV-Aufnahme, Stoppen und Unmount, Mikrofonfehler mit erneutem Versuch sowie
automatisches Zeitlimit und schmale Ansicht. Benötigt Web-Abhängigkeiten und
automatisches Zeitlimit und schmale Ansicht. Ein Wechsel Deutsch → Englisch
→ Deutsch während einer Aufnahme darf keinen neuen Stream starten oder die
Aufnahme abbrechen; auch englische Aufnahme- und Monitoringbeschriftungen werden
geprüft. Benötigt Web-Abhängigkeiten und
Playwright mit Chromium, aber keine API oder Datenbank. Aus `apps/web`:
```bash
@@ -34,11 +37,36 @@ go test ./internal/httpapi -run TestPronunciationBrowserSmoke -v -count=1
Auch diese Fixture benötigt den freien Port 15175. Alle drei Browser-Smokes
nacheinander ausführen, nicht parallel.
`languages.e2e.cjs` läuft vor dem Kursbank-Smoke in derselben lokalen Fixture.
Es prüft vollständige Übersetzungsschlüssel/Platzhalter, Sprachwahl vor dem Login,
Registrierung, Wiederanmeldung mit Kontosprache, Speicherung nach Neuladen,
getrennte Erklärungssprache und fehlgeschlagene Speichervorgänge. Die Bedienung
von Aussprache, Dialog, Administration und festem Altkurs wird auf Englisch
geprüft. Eingegebene Dialogantworten und ungespeicherte Budgetfelder müssen einen
Sprachwechsel überstehen; die Sprachwahl darf diese Felder nicht speichern.
Lokale Statusmeldungen wechseln mit der Oberfläche ihre Sprache. Ein UI-only-PATCH
muss die aktive Lernsprache, A2-Niveau und ein abweichendes Tagesziel erhalten.
Die Kontoeinstellungen der Fixture werden vor dem anschließenden Bank-Smoke zurückgesetzt.
Alle Konten und Änderungen liegen ausschließlich in dessen zufälligem Testschema.
`course-variants.e2e.cjs` läuft zusätzlich mit einem neuen regulären Testkonto.
Es prüft die Erklärungssprachwahl unabhängig von der Oberfläche, alle zwölf
Pilotvarianten, die fünf Darstellungen, angepasste Bedeutungs-/Schreibaufgaben,
private Hörtexte und Lösungsschlüssel, unbenotete Antworten, Reload und die
unveränderte historische Ansicht nach einem Präferenzwechsel. Fehlende englische
Module erhalten keine deutschen Reserven; neue englische Tests werden abgelehnt,
während ein vorhandener deutscher Test über dieselbe Request-ID fortgesetzt
wird. Der Test löst keine Modellaufrufe aus. Der gesamte Bank-Smoke läuft danach
weiterhin vollständig auf Deutsch und Englisch als Oberflächensprache.
`course-bank.e2e.cjs` prüft den Kurs mit 840 Aufgaben, sieben Modulen, allen sechs
Lernbereichen und den fünf Darstellungsformen. Geprüft werden außerdem neue
Aufgabenzuweisungen, Neuladen, unbewertete offene Antworten mit Selbstvergleich
und ein vollständig abgegebener Test ohne vorzeitige Note oder Lösungsausgabe.
Die Prüfung bestätigt, dass dabei keine Modellaufrufe erfasst werden.
Die Prüfung läuft vollständig auf Deutsch und Englisch und bestätigt, dass dabei
keine Modellaufrufe erfasst werden. Sichtbare Aufgaben und Auswahloptionen müssen
den gespeicherten Originalen entsprechen; eine eingegebene Schreibantwort muss
beim Wechsel der Oberflächensprache erhalten bleiben.
Aus `apps/api` mit den unten beschriebenen Voraussetzungen:
+33 -2
View File
@@ -19,12 +19,18 @@ const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
import React from '/node_modules/.vite/deps/react.js';
import ReactDOM from '/node_modules/.vite/deps/react-dom_client.js';
import { AudioRecorder } from '/src/components/AudioRecorder.tsx';
import { I18nProvider, useI18n } from '/src/i18n/I18n.tsx';
import '/src/app/styles.css';
const root = ReactDOM.createRoot(document.getElementById('root'));
function RecorderFixture(props) {
const { setLanguage } = useI18n();
window.setRecorderLanguage = setLanguage;
return React.createElement(AudioRecorder, props);
}
window.blobs = [];
window.renderRecorder = (maxSeconds, enableMonitoring = false) => root.render(React.createElement(AudioRecorder, {
window.renderRecorder = (maxSeconds, enableMonitoring = false) => root.render(React.createElement(I18nProvider, null, React.createElement(RecorderFixture, {
key: String(maxSeconds) + enableMonitoring, maxSeconds, enableMonitoring, onRecorded: blob => window.blobs.push(blob)
}));
})));
window.unmountRecorder = () => root.unmount();
window.renderRecorder();
</script></html>`);
@@ -39,10 +45,18 @@ const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
await page.addInitScript(() => {
const RealContext = window.AudioContext;
window.contexts = [];
window.captures = [];
window.monitors = [];
window.streams = [];
window.AudioContext = class extends RealContext {
constructor(options) { super(options); window.contexts.push(this); }
createScriptProcessor(...args) {
const processor = super.createScriptProcessor(...args);
const capture = { samples: 0, rate: this.sampleRate };
window.captures.push(capture);
processor.addEventListener('audioprocess', event => { capture.samples += event.inputBuffer.length; });
return processor;
}
createGain() {
const gain = super.createGain();
const analyser = super.createAnalyser();
@@ -95,6 +109,8 @@ const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
await page.waitForFunction(() => window.monitorRMS() > 0.1 && window.monitorRMS() < 0.2);
await toggle.uncheck();
await page.waitForFunction(() => window.monitorRMS() < 0.001);
// Collect enough real callback frames for the RMS windows checked below.
await page.waitForFunction(() => window.captures.at(-1).samples >= window.captures.at(-1).rate * 0.6);
await page.getByRole('button', { name: 'Stoppen' }).click();
await page.waitForFunction(() => window.contexts.every(c => c.state === 'closed'));
assert(await page.evaluate(() => window.streams.every(s => s.getTracks().every(t => t.readyState === 'ended'))));
@@ -129,6 +145,21 @@ const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
await page.evaluate(() => { window.rejectMic = false; window.renderRecorder(1); });
await page.getByRole('button', { name: 'Aufnehmen', exact: true }).click();
await page.waitForFunction(() => window.blobs.length === 1 && window.contexts.every(c => c.state === 'closed'));
await page.evaluate(() => { window.renderRecorder(undefined, true); window.setRecorderLanguage('en-US'); });
await page.getByRole('button', { name: 'Record', exact: true }).click();
await page.getByRole('button', { name: 'Stop', exact: true }).waitFor();
const streamsBefore = await page.evaluate(() => window.streams.length);
const blobsBefore = await page.evaluate(() => window.blobs.length);
await page.evaluate(() => window.setRecorderLanguage('de-DE'));
await page.getByRole('button', { name: 'Stoppen', exact: true }).waitFor();
assert.equal(await page.evaluate(() => window.streams.length), streamsBefore);
assert.equal(await page.evaluate(() => window.contexts.at(-1).state), 'running');
await page.evaluate(() => window.setRecorderLanguage('en-US'));
await page.getByRole('switch', { name: 'Monitor your own voice' }).waitFor();
await page.getByRole('slider', { name: 'Monitoring volume', exact: true }).waitFor();
await page.waitForFunction(() => window.captures.at(-1).samples > 0);
await page.getByRole('button', { name: 'Stop', exact: true }).click();
await page.waitForFunction(count => window.blobs.length === count + 1, blobsBefore);
assert.deepEqual(errors, []);
await page.setViewportSize({ width: 320, height: 800 });
assert(await page.evaluate(() => document.documentElement.scrollWidth <= innerWidth));
+17 -12
View File
@@ -3,27 +3,32 @@ const assert=require('node:assert/strict');
const crypto=require('node:crypto');
(async()=>{
const api=process.env.AI_E2E_API,token=process.env.AI_E2E_TOKEN,url=process.env.AI_E2E_URL;assert(api&&token&&url);
const english=process.env.UI_E2E_LANGUAGE==='en-US';
const translations={
'A1-Kurs':'A1 course','A1-Module':'A1 modules','Lernbereich':'Learning area','Aktuelle Kursaufgabe':'Current course exercise','Nächste Aufgabe':'Next exercise','Aus geprüftem Aufgabenbestand':'From the reviewed exercise bank','Grammatik':'Grammar','Antwort prüfen':'Check answer','100 / 100 · Richtig':'100 / 100 · Correct','Wortschatz':'Vocabulary','Lesen':'Reading','Hören':'Listening','Anhören':'Listen','Sprechen':'Speaking','Bis zu 30 Sekunden.':'Up to 30 seconds.','Schreiben':'Writing','Deine Antwort':'Your answer','Antwort gespeichert – ohne verbindliche Note.':'Answer saved without a grade.','Beispiel:':'Example:','Bewertung anfordern':'Request evaluation','Neuen A1-Test starten · 12 Aufgaben':'Start a new A1 test · 12 questions','A1-Test':'A1 test','Abgegeben – Bewertung ausstehend.':'Submitted – evaluation pending.','Ausstehende Antworten bewerten':'Evaluate pending answers'
};
const label=value=>english?(translations[value]??value):value;
const browser=await chromium.launch({headless:true,args:['--no-sandbox']});
try{
const page=await browser.newPage();page.setDefaultTimeout(15000);const errors=[];page.on('pageerror',e=>errors.push(e.message));const headers={Authorization:`Bearer ${token}`};
const get=async path=>{const r=await page.request.get(api+path,{headers});assert.equal(r.status(),200);return r.json()};
const post=async(path,data)=>{const r=await page.request.post(api+path,{headers,data});assert(r.status()<300,await r.text());return r.json()};
await page.goto(url);await page.evaluate(t=>localStorage.setItem('speech_token',t),token);await page.reload();await page.getByRole('button',{name:'A1-Kurs',exact:true}).click();
await page.goto(url);await page.evaluate(t=>localStorage.setItem('speech_token',t),token);await page.reload();if(english)await page.getByRole('combobox',{name:'Oberflächensprache'}).selectOption('en-US');await page.getByRole('button',{name:label('A1-Kurs'),exact:true}).click();
const cat=await get('/course/catalog');assert.equal(cat.task_mode,'bank');assert.equal(cat.grading_available,false);assert.equal(cat.bank.reduce((n,b)=>n+b.total,0),840);
const modules=page.getByRole('navigation',{name:'A1-Module'}).getByRole('button');await modules.nth(6).waitFor();assert.equal(await modules.count(),7);await modules.nth(1).click();
const areas=page.getByRole('group',{name:'Lernbereich'}),ex=page.getByRole('region',{name:'Aktuelle Kursaufgabe'});
async function next(area){await areas.getByRole('button',{name:area,exact:true}).click();const response=page.waitForResponse(r=>r.url().endsWith('/tasks/next')&&r.request().method()==='POST');await page.getByRole('button',{name:'Nächste Aufgabe',exact:true}).click();let j=await(await response).json();for(let n=0;n<40&&j.status!=='succeeded';n++){await page.waitForTimeout(150);j=await get('/course/jobs/'+j.id);if(j.status==='failed')throw new Error(j.error)}assert.equal(j.source,'curated');await ex.getByText('Aus geprüftem Aufgabenbestand',{exact:false}).waitFor();await page.getByRole('button',{name:'Nächste Aufgabe',exact:true}).waitFor({state:'visible'});return get('/course/tasks/'+j.task_id)}
let d=await next('Grammatik');const first=d.task.id;assert.equal(d.task.answer_key,undefined);await ex.getByRole('radio').first().check();await ex.getByRole('button',{name:'Antwort prüfen',exact:true}).click();await ex.getByRole('status').waitFor();d=await get('/course/tasks/'+first);await ex.locator('input[value="'+d.task.answer_key.correct_option_id+'"]').check();await ex.getByRole('button',{name:'Antwort prüfen',exact:true}).click();await ex.getByText('100 / 100 · Richtig',{exact:true}).waitFor();
await page.reload();await page.getByRole('button',{name:'A1-Kurs',exact:true}).click();await ex.getByText('100 / 100 · Richtig',{exact:true}).waitFor();d=await next('Grammatik');assert.notEqual(d.task.id,first);
await next('Wortschatz');await next('Lesen');await ex.locator('.course-passage').waitFor();d=await next('Hören');assert.equal(d.task.audio_text,undefined);await ex.getByRole('button',{name:'Anhören',exact:true}).waitFor();
await next('Sprechen');await ex.getByText('Bis zu 30 Sekunden.',{exact:false}).waitFor();d=await next('Schreiben');await ex.getByRole('textbox',{name:'Deine Antwort'}).fill('I have got a sister.');await ex.getByRole('button',{name:'Antwort prüfen',exact:true}).click();await ex.getByText('Antwort gespeichert – ohne verbindliche Note.',{exact:false}).waitFor();await ex.getByText('Beispiel:',{exact:false}).waitFor();
await page.reload();await page.getByRole('button',{name:'A1-Kurs',exact:true}).click();await ex.getByText('Antwort gespeichert – ohne verbindliche Note.',{exact:false}).waitFor();assert(await ex.getByRole('button',{name:'Bewertung anfordern',exact:true}).isDisabled());
await modules.nth(6).click();await page.getByRole('button',{name:'Neuen A1-Test starten · 12 Aufgaben',exact:true}).click();const examPanel=page.getByRole('region',{name:'A1-Test'});await examPanel.getByRole('button').nth(11).waitFor();let catalog=await get('/course/catalog'),exam=await get('/course/exams/'+catalog.exams[0].id);assert.equal(exam.tasks.length,12);
const modules=page.getByRole('navigation',{name:label('A1-Module')}).getByRole('button');await modules.nth(6).waitFor();assert.equal(await modules.count(),7);await modules.nth(1).click();
const areas=page.getByRole('group',{name:label('Lernbereich')}),ex=page.getByRole('region',{name:label('Aktuelle Kursaufgabe')});
async function next(area){await areas.getByRole('button',{name:label(area),exact:true}).click();const response=page.waitForResponse(r=>r.url().endsWith('/tasks/next')&&r.request().method()==='POST');await page.getByRole('button',{name:label('Nächste Aufgabe'),exact:true}).click();let j=await(await response).json();for(let n=0;n<40&&j.status!=='succeeded';n++){await page.waitForTimeout(150);j=await get('/course/jobs/'+j.id);if(j.status==='failed')throw new Error(j.error)}assert.equal(j.source,'curated');await ex.getByText(label('Aus geprüftem Aufgabenbestand'),{exact:false}).waitFor();await page.getByRole('button',{name:label('Nächste Aufgabe'),exact:true}).waitFor({state:'visible'});return get('/course/tasks/'+j.task_id)}
let d=await next('Grammatik');const first=d.task.id;assert.equal(d.task.answer_key,undefined);assert.equal(await ex.getByRole('heading',{level:2}).innerText(),d.task.prompt);assert.deepEqual(await ex.locator('.course-option').allTextContents(),d.task.options.map(o=>o.label));await ex.getByRole('radio').first().check();await ex.getByRole('button',{name:label('Antwort prüfen'),exact:true}).click();await ex.getByRole('status').waitFor();d=await get('/course/tasks/'+first);await ex.locator('input[value="'+d.task.answer_key.correct_option_id+'"]').check();await ex.getByRole('button',{name:label('Antwort prüfen'),exact:true}).click();await ex.getByText(label('100 / 100 · Richtig'),{exact:true}).waitFor();
await page.reload();await page.getByRole('button',{name:label('A1-Kurs'),exact:true}).click();await ex.getByText(label('100 / 100 · Richtig'),{exact:true}).waitFor();d=await next('Grammatik');assert.notEqual(d.task.id,first);
await next('Wortschatz');await next('Lesen');await ex.locator('.course-passage').waitFor();d=await next('Hören');assert.equal(d.task.audio_text,undefined);await ex.getByRole('button',{name:label('Anhören'),exact:true}).waitFor();
await next('Sprechen');await ex.getByText(label('Bis zu 30 Sekunden.'),{exact:false}).waitFor();d=await next('Schreiben');await ex.getByRole('textbox',{name:label('Deine Antwort')}).fill('I have got a sister.');if(english){await page.getByRole('combobox',{name:'Interface language'}).selectOption('de-DE');const germanExercise=page.getByRole('region',{name:'Aktuelle Kursaufgabe'});await germanExercise.getByRole('textbox',{name:'Deine Antwort'}).waitFor();assert.equal(await germanExercise.getByRole('textbox',{name:'Deine Antwort'}).inputValue(),'I have got a sister.');assert.equal(await germanExercise.getByRole('heading',{level:2}).innerText(),d.task.prompt);await page.getByRole('combobox',{name:'Oberflächensprache'}).selectOption('en-US');}await ex.getByRole('button',{name:label('Antwort prüfen'),exact:true}).click();await ex.getByText(label('Antwort gespeichert – ohne verbindliche Note.'),{exact:false}).waitFor();await ex.getByText(label('Beispiel:'),{exact:false}).waitFor();
await page.reload();await page.getByRole('button',{name:label('A1-Kurs'),exact:true}).click();await ex.getByText(label('Antwort gespeichert – ohne verbindliche Note.'),{exact:false}).waitFor();assert(await ex.getByRole('button',{name:label('Bewertung anfordern'),exact:true}).isDisabled());
await modules.nth(6).click();await page.getByRole('button',{name:label('Neuen A1-Test starten · 12 Aufgaben'),exact:true}).click();const examPanel=page.getByRole('region',{name:label('A1-Test')});await examPanel.getByRole('button').nth(11).waitFor();let catalog=await get('/course/catalog'),exam=await get('/course/exams/'+catalog.exams[0].id);assert.equal(exam.tasks.length,12);
const wav=Buffer.alloc(44+8000);wav.write('RIFF');wav.writeUInt32LE(wav.length-8,4);wav.write('WAVE',8);wav.write('fmt ',12);wav.writeUInt32LE(16,16);wav.writeUInt16LE(1,20);wav.writeUInt16LE(1,22);wav.writeUInt32LE(16000,24);wav.writeUInt32LE(32000,28);wav.writeUInt16LE(2,32);wav.writeUInt16LE(16,34);wav.write('data',36);wav.writeUInt32LE(8000,40);
for(const t of exam.tasks){assert.equal(t.answer_key,undefined);assert.equal(t.audio_text,undefined);const request_id=crypto.randomUUID().replaceAll('-','');if(['repeat_sentence','free_speech'].includes(t.kind)){const r=await page.request.post(api+'/course/tasks/'+t.id+'/audio-attempts',{headers,multipart:{request_id,audio:{name:'fixture.wav',mimeType:'audio/wav',buffer:wav}}});assert.equal(r.status(),202,await r.text())}else await post('/course/tasks/'+t.id+'/attempts',{request_id,answer:t.kind==='choice'?t.options[0].id:'I have got a sister.'})}
exam=await get('/course/exams/'+exam.id);assert.equal(exam.status,'submitted');assert.equal(exam.score,undefined);for(const t of exam.tasks){assert.equal(t.answer_key,undefined);assert.equal(t.audio_text,undefined);const detail=await get('/course/tasks/'+t.id);assert.equal(detail.task.answer_key,undefined)}for(const a of exam.attempts)assert.equal(a.evaluation,undefined);
await page.reload();await page.getByRole('button',{name:'A1-Kurs',exact:true}).click();await examPanel.getByText('Abgegeben – Bewertung ausstehend.',{exact:false}).waitFor();assert(await examPanel.getByRole('button',{name:'Ausstehende Antworten bewerten',exact:true}).isDisabled());
await page.reload();await page.getByRole('button',{name:label('A1-Kurs'),exact:true}).click();await examPanel.getByText(label('Abgegeben – Bewertung ausstehend.'),{exact:false}).waitFor();assert(await examPanel.getByRole('button',{name:label('Ausstehende Antworten bewerten'),exact:true}).isDisabled());
const usage=await get('/admin/ai/usage');assert.equal(usage.total,0);assert.deepEqual(errors,[]);
console.log('PASS: 840 bank tasks; six renderers; source/privacy; answer/reload; ungraded open answer; submitted frozen exam; no model calls or browser errors. Audio uses an explicit local fixture.');
console.log((english?'English: ':'German: ')+'PASS: 840 bank tasks; six renderers; source/privacy; answer/reload; ungraded open answer; submitted frozen exam; no model calls or browser errors. Audio uses an explicit local fixture.');
}finally{await browser.close()}
})().catch(e=>{console.error(e);process.exitCode=1});
+118
View File
@@ -0,0 +1,118 @@
// Local API/PostgreSQL fixture only. No paid provider calls or real microphone.
const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
const assert = require('node:assert/strict');
const crypto = require('node:crypto');
(async () => {
const api = process.env.AI_E2E_API, url = process.env.AI_E2E_URL, adminToken = process.env.AI_E2E_TOKEN;
assert(api && url && adminToken);
const browser = await chromium.launch({ headless: true, args: ['--no-sandbox'] });
try {
const page = await browser.newPage(); page.setDefaultTimeout(15000);
const errors = []; page.on('pageerror', error => errors.push(error.message));
const registration = await page.request.post(api + '/auth/register', { data: { email: `variants-${Date.now()}@example.test`, password: 'local-variant-test-password', ui_language: 'en-US', target_language: 'en-US' } });
assert.equal(registration.status(), 201);
const account = await registration.json(), headers = { Authorization: `Bearer ${account.token}` };
const id = () => crypto.randomUUID().replaceAll('-', '');
const get = async path => { const response = await page.request.get(api + path, { headers }); assert.equal(response.status(), 200, await response.text()); return response.json(); };
const explanation = () => page.getByRole('combobox', { name: 'Exercise explanation language' });
const exercise = page.getByRole('region', { name: 'Current course exercise' });
async function waitJob(job) {
for (let count = 0; count < 80 && ['queued', 'running'].includes(job.status); count++) {
await page.waitForTimeout(100); job = await get('/course/jobs/' + job.id);
}
return job;
}
async function next(skill) {
await page.getByRole('group', { name: 'Learning area' }).getByRole('button', { name: skill, exact: true }).click();
const response = page.waitForResponse(r => r.url().endsWith('/tasks/next') && r.request().method() === 'POST');
await page.getByRole('button', { name: 'Next exercise', exact: true }).click();
const job = await waitJob(await (await response).json()); assert.equal(job.status, 'succeeded', job.error);
const detail = await get('/course/tasks/' + job.task_id);
await exercise.getByRole('heading', { level: 2, name: detail.task.instruction, exact: true }).waitFor();
await page.getByRole('button', { name: 'Next exercise', exact: true }).waitFor();
assert.equal(detail.task.instruction_language, 'en-US'); assert(detail.task.content_revision); assert(detail.task.variant_id);
assert.equal(detail.task.answer_key, undefined); assert.equal(detail.task.audio_text, undefined); assert.equal(detail.task.evidence_task_id, undefined);
return detail.task;
}
await page.goto(url); await page.evaluate(token => localStorage.setItem('speech_token', token), account.token); await page.reload();
await page.getByRole('button', { name: 'A1 course', exact: true }).click();
await explanation().selectOption('en-US');
await page.getByText('Preferred explanation language: English.', { exact: true }).waitFor();
let catalog = await get('/course/catalog');
assert.equal(catalog.modules[0].title, 'Greetings & introductions');
assert.equal(catalog.instruction_language, 'en-US'); assert.equal(catalog.exam_available, false);
assert.equal(catalog.bank.reduce((sum, item) => sum + item.total, 0), 12);
assert(catalog.bank.every(item => item.module_id === 'a1_introductions_v1' && item.total === 2));
const grammar = await next('Grammar');
await exercise.locator('.course-passage').getByText(grammar.stimulus.text, { exact: true }).waitFor();
assert.equal(grammar.stimulus.role, 'target'); assert.equal(grammar.stimulus.language, 'en-US');
for (let n = 0; n < 2; n++) {
const task = await next('Vocabulary');
assert.equal(task.canonical_task_id, task.variant_id, 'Adapted meanings require a separate canonical identity');
assert(task.options.every(option => option.language === 'en-US' && !['hello', 'name'].includes(option.label.toLowerCase())));
assert(!task.options.some(option => ['hallo', 'tschüss', 'Name', 'Alter', 'Wohnort'].includes(option.label)));
}
await next('Reading'); await exercise.locator('.course-passage').waitFor();
const listening = await next('Listening'); assert.equal(listening.stimulus, undefined);
await exercise.getByRole('button', { name: 'Listen', exact: true }).waitFor();
assert.equal(await exercise.getByText('Listening transcript:', { exact: false }).count(), 0);
for (let n = 0; n < 2; n++) {
const task = await next('Speaking');
assert(['repeat_sentence', 'free_speech'].includes(task.kind));
await exercise.getByRole('button', { name: 'Record', exact: true }).waitFor();
assert.equal(Boolean(task.reference_text), task.kind === 'repeat_sentence');
}
const writing = await next('Writing');
assert.equal(writing.kind, 'short_text'); assert.equal(writing.canonical_task_id, writing.variant_id);
assert(!writing.instruction.toLowerCase().includes('translate')); assert.equal(writing.stimulus.role, 'context');
await exercise.getByRole('textbox', { name: 'Your answer' }).fill('I am Anna.');
await exercise.getByRole('button', { name: 'Check answer', exact: true }).click();
await exercise.getByText('Answer saved without a grade.', { exact: false }).waitFor();
let saved = await get('/course/tasks/' + writing.id);
assert.equal(saved.attempt.status, 'ungraded'); assert.equal(saved.attempt.answer, 'I am Anna.'); assert.equal(saved.attempt.evaluation, undefined);
assert.equal(saved.task.answer_key.reference_answer_language, 'en-US');
const frozen = saved.task;
await explanation().selectOption('de-DE');
await page.getByText('Preferred explanation language: German.', { exact: true }).waitFor();
await exercise.getByText('This exercise uses: English', { exact: true }).waitFor();
saved = await get('/course/tasks/' + writing.id); assert.deepEqual(saved.task, frozen);
await page.reload(); await page.getByRole('button', { name: 'A1 course', exact: true }).click();
await exercise.getByRole('heading', { name: writing.instruction, exact: true }).waitFor();
saved = await get('/course/tasks/' + writing.id); assert.equal(saved.attempt.answer, 'I am Anna.'); assert.deepEqual(saved.task, frozen);
const currentUser = await get('/me'); assert.equal(currentUser.user.ui_language, 'en-US'); assert.deepEqual(currentUser.profile, account.profile);
await explanation().selectOption('en-US');
await page.getByText('Preferred explanation language: English.', { exact: true }).waitFor();
const freeWriting = await next('Writing'); assert.equal(freeWriting.kind, 'free_text');
const modules = page.getByRole('navigation', { name: 'A1 modules' }).getByRole('button');
await modules.nth(1).click();
await page.getByText('This area has no reviewed exercises', { exact: false }).waitFor();
assert(await page.getByRole('button', { name: 'Next exercise', exact: true }).isDisabled());
const missing = await page.request.post(api + '/course/modules/a1_family_v1/tasks/next', { headers, data: { request_id: id(), skill: 'grammar' } });
assert.equal(missing.status(), 202); const failed = await waitJob(await missing.json()); assert.equal(failed.status, 'failed'); assert.equal(failed.task_id, undefined);
assert.equal((await get('/course/modules/a1_family_v1/tasks')).tasks.length, 0);
await modules.nth(6).click();
assert(await page.getByRole('button', { name: 'Start a new A1 test · 12 questions', exact: true }).isDisabled());
const unsupportedExam = await page.request.post(api + '/course/exams', { headers, data: { request_id: id() } });
assert.equal(unsupportedExam.status(), 409); assert.equal((await unsupportedExam.json()).code, 'course_variant_unavailable');
catalog = await get('/course/catalog'); assert.equal(catalog.exams.length, 0);
// Reusing an existing German test request must keep that frozen session.
await page.request.put(api + '/course/instruction-language', { headers, data: { instruction_language: 'de-DE' } });
const examRequest = id();
const germanExamResponse = await page.request.post(api + '/course/exams', { headers, data: { request_id: examRequest } });
assert.equal(germanExamResponse.status(), 202);
const germanExam = await germanExamResponse.json();
assert.equal((await waitJob(germanExam.job)).status, 'succeeded');
await page.request.put(api + '/course/instruction-language', { headers, data: { instruction_language: 'en-US' } });
const replayResponse = await page.request.post(api + '/course/exams', { headers, data: { request_id: examRequest } });
assert.equal(replayResponse.status(), 202);
const replay = await replayResponse.json(); assert.equal(replay.exam.id, germanExam.exam.id); assert.equal(replay.job.id, germanExam.job.id); assert.equal(replay.job.instruction_language, 'de-DE');
const unsupported = await page.request.put(api + '/course/instruction-language', { headers, data: { instruction_language: 'fr-FR' } });
assert.equal(unsupported.status(), 409); assert.equal((await unsupported.json()).code, 'course_variant_unavailable');
assert.equal((await get('/me')).user.instruction_language, 'en-US');
const anonymous = await page.request.put(api + '/course/instruction-language', { data: { instruction_language: 'de-DE' } }); assert.equal(anonymous.status(), 401);
const usage = await page.request.get(api + '/admin/ai/usage', { headers: { Authorization: `Bearer ${adminToken}` } }); assert.equal((await usage.json()).total, 0);
assert.deepEqual(errors, []);
console.log('PASS: explanation choice; 12 structured pilot variants; five renderers/six skills; independent UI language; adapted vocabulary/writing; frozen answers/reload; no German fallback; unavailable English exam; auth; no model calls.');
} finally { await browser.close(); }
})().catch(error => { console.error(error); process.exitCode = 1; });
+141
View File
@@ -0,0 +1,141 @@
const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
const assert = require('node:assert/strict');
const fs = require('node:fs');
(async () => {
const api = process.env.AI_E2E_API, token = process.env.AI_E2E_TOKEN, url = process.env.AI_E2E_URL;
assert(api && token && url);
const german = JSON.parse(fs.readFileSync('src/i18n/de-DE.json', 'utf8'));
const english = JSON.parse(fs.readFileSync('src/i18n/en-US.json', 'utf8'));
assert.deepEqual(Object.keys(german).sort(), Object.keys(english).sort());
for (const key of Object.keys(german)) {
assert(german[key] && english[key], `Empty translation: ${key}`);
assert.deepEqual(german[key].match(/\{\w+\}/g)?.sort() ?? [], english[key].match(/\{\w+\}/g)?.sort() ?? [], key);
}
const browser = await chromium.launch({ headless: true, args: ['--no-sandbox'] });
try {
const page = await browser.newPage();
page.setDefaultTimeout(15000);
const errors = [];
page.on('pageerror', (error) => errors.push(error.message));
const headers = { Authorization: `Bearer ${token}` };
const me = async () => {
const response = await page.request.get(api + '/me', { headers });
assert.equal(response.status(), 200);
return response.json();
};
const patch = async (data) => {
const response = await page.request.patch(api + '/me/preferences', { headers, data });
assert.equal(response.status(), 200, await response.text());
return response.json();
};
await page.goto(url);
await page.getByRole('heading', { name: 'Einloggen', exact: true }).waitFor();
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
await page.getByRole('heading', { name: 'Log in', exact: true }).waitFor();
assert.equal(await page.locator('html').getAttribute('lang'), 'en-US');
await page.reload();
await page.getByRole('heading', { name: 'Log in', exact: true }).waitFor();
await page.getByRole('button', { name: 'Create account', exact: true }).click();
await page.getByText('The English course currently uses German task instructions and explanations.').waitFor();
await page.setViewportSize({ width: 360, height: 780 });
assert(await page.evaluate(() => document.documentElement.scrollWidth <= window.innerWidth), 'Registration overflows on a narrow screen');
await page.setViewportSize({ width: 1280, height: 800 });
const email = `languages-${Date.now()}@example.test`, password = 'local-language-test-password';
await page.getByRole('textbox', { name: 'Email', exact: true }).fill(email);
await page.getByLabel('Password', { exact: true }).fill(password);
const registration = page.waitForResponse((r) => r.url().endsWith('/auth/register') && r.request().method() === 'POST');
await page.getByRole('button', { name: 'Register', exact: true }).click();
const registered = await (await registration).json();
assert.equal(registered.user.ui_language, 'en-US');
assert.equal(registered.user.instruction_language, 'de-DE');
await page.getByRole('button', { name: 'Today', exact: true }).waitFor();
await page.getByText('Preferred explanation language: German.', { exact: true }).waitFor();
await page.getByRole('heading', { name: 'A1 pronunciation practice', exact: true }).waitFor();
await page.getByRole('button', { name: 'Log out', exact: true }).click();
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
await page.getByRole('textbox', { name: 'E-Mail', exact: true }).fill(email);
await page.getByLabel('Passwort', { exact: true }).fill(password);
await page.getByRole('button', { name: 'Einloggen', exact: true }).click();
await page.getByRole('button', { name: 'Today', exact: true }).waitFor();
await page.getByRole('button', { name: 'Progress', exact: true }).click();
await page.getByRole('heading', { name: 'Progress', exact: true }).waitFor();
await page.getByRole('heading', { name: 'Your pronunciation profile · en-US', exact: true }).waitFor();
await page.getByText('Your new pronunciation profile needs confirmed measurements.', { exact: false }).waitFor();
await page.getByRole('button', { name: 'Log out', exact: true }).click();
const original = await me();
await page.evaluate((value) => localStorage.setItem('speech_token', value), token);
await page.reload();
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
await page.getByRole('button', { name: 'Pronunciation', exact: true }).click();
await page.getByRole('button', { name: 'Record', exact: true }).waitFor();
const sentence = await page.locator('.target-text').innerText();
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
await page.getByRole('button', { name: 'Aufnehmen', exact: true }).waitFor();
assert.equal(await page.locator('.target-text').innerText(), sentence);
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
await page.getByRole('button', { name: 'Conversation', exact: true }).click();
await page.getByRole('button', { name: 'Start', exact: true }).click();
const reply = page.getByRole('textbox', { name: 'Your conversation reply', exact: true });
await reply.fill('My name is Mira.');
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
assert.equal(await page.getByRole('textbox', { name: 'Deine Dialogantwort', exact: true }).inputValue(), 'My name is Mira.');
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
const turnResponse = page.waitForResponse(r => /\/conversation\/[^/]+\/turn$/.test(r.url()));
await page.getByRole('button', { name: 'Send', exact: true }).click();
assert.equal((await turnResponse).request().postDataJSON().text, 'My name is Mira.');
await page.locator('.bubble.learner').getByText('My name is Mira.', { exact: true }).waitFor();
await page.getByRole('button', { name: 'Administration', exact: true }).click();
await page.getByRole('heading', { name: 'AI settings and usage', exact: true }).waitFor();
const action = page.getByLabel('Action').first();
await action.selectOption('next_exercise');
await page.getByRole('option', { name: 'Pronunciation generation', exact: true }).first().waitFor({ state: 'attached' });
await page.getByLabel('Monthly limit in USD', { exact: true }).fill('0.12');
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
assert.equal(await page.getByLabel('Monatslimit in USD', { exact: true }).inputValue(), '0.12');
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
assert.equal(await page.getByLabel('Monthly limit in USD', { exact: true }).inputValue(), '0.12');
const settings = await (await page.request.get(api + '/admin/ai/settings', { headers })).json();
assert.equal(settings.budget.monthly_limit_microusd, 0, 'Changing UI language must not save budget edits');
await page.getByLabel('Monthly limit in USD', { exact: true }).fill('0');
await page.getByRole('button', { name: 'Save budget', exact: true }).click();
await page.getByRole('status').filter({ hasText: 'Budget saved.' }).waitFor();
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
await page.getByRole('status').filter({ hasText: 'Budget gespeichert.' }).waitFor();
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
await page.getByRole('status').filter({ hasText: 'Budget saved.' }).waitFor();
await page.getByRole('button', { name: 'A1 course', exact: true }).click();
await page.getByRole('button', { name: 'Open the original fixed course', exact: true }).click();
await page.getByText('Guided A1 course', { exact: true }).waitFor();
await page.getByRole('region', { name: 'Module progress', exact: true }).waitFor();
await patch({ ui_language: original.user.ui_language });
const learningProfile = await patch({ target_language: 'es-ES', cefr_level: 'A2', daily_goal_minutes: 23 });
await page.evaluate((value) => localStorage.setItem('speech_token', value), token);
await page.reload();
const picker = page.getByRole('combobox', { name: 'Oberflächensprache' });
await picker.waitFor();
await picker.selectOption('en-US');
await page.getByRole('button', { name: 'Today', exact: true }).waitFor();
let account = await me();
assert.equal(account.user.ui_language, 'en-US');
assert.equal(account.user.instruction_language, original.user.instruction_language);
assert.deepEqual(account.profile, learningProfile);
await page.reload();
await page.getByRole('combobox', { name: 'Interface language' }).waitFor();
assert.equal(await page.locator('html').getAttribute('lang'), 'en-US');
await page.route('**/me/preferences', (route) => route.fulfill({ status: 503, contentType: 'application/json', body: '{"error":"fixture unavailable"}' }));
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
await page.getByRole('alert').filter({ hasText: 'Unable to save the language.' }).waitFor();
assert.equal(await page.getByRole('combobox', { name: 'Interface language' }).inputValue(), 'en-US');
account = await me();
assert.equal(account.user.ui_language, 'en-US');
assert.deepEqual(account.profile, learningProfile);
await page.unroute('**/me/preferences');
const rejected = await page.request.patch(api + '/me/preferences', { headers, data: { ui_language: 'xx-XX' } });
assert.equal(rejected.status(), 400);
await patch({ ui_language: original.user.ui_language, target_language: original.profile.target_language, cefr_level: original.profile.cefr_level, daily_goal_minutes: original.profile.daily_goal_minutes });
assert.deepEqual(errors, []);
console.log('PASS: catalog parity; language before login; registration/login; account persistence; independent instructions; pronunciation, conversation, admin and legacy controls; unsaved input survives language switches; partial PATCH preserves course/level/goal; rejected saves; no browser errors.');
} finally { await browser.close(); }
})().catch((error) => { console.error(error); process.exitCode = 1; });