Mehrsprachige Bedienung und versionierte Aufgabenvarianten einführen
Übersetzungskataloge, getrennte Sprachpräferenzen und einen versionierten Aufgabenpilot ergänzen. Historische Aufgaben und Bewertungen bleiben erhalten; äquivalente Ansichten teilen Nachweise. Lokal mit Race-Tests und PostgreSQL, Vet, Web-Build, Bank-Audits und Browser-Fixtures geprüft. Dieser Stand dient als Ausgangspunkt für die anschließend beauftragte Zusammenführung zur Muttersprache.
This commit is contained in:
@@ -5,7 +5,10 @@ synthetischen Mikrofonsignal: standardmäßig keine Mithörbedienung und kein
|
||||
Mithörpfad; nach expliziter Freigabe über `enableMonitoring` zunächst ausgeschaltetes Mithören, Schalter und
|
||||
Lautstärke während der Aufnahme, tatsächliche Signalpegel, unveränderte
|
||||
WAV-Aufnahme, Stoppen und Unmount, Mikrofonfehler mit erneutem Versuch sowie
|
||||
automatisches Zeitlimit und schmale Ansicht. Benötigt Web-Abhängigkeiten und
|
||||
automatisches Zeitlimit und schmale Ansicht. Ein Wechsel Deutsch → Englisch
|
||||
→ Deutsch während einer Aufnahme darf keinen neuen Stream starten oder die
|
||||
Aufnahme abbrechen; auch englische Aufnahme- und Monitoringbeschriftungen werden
|
||||
geprüft. Benötigt Web-Abhängigkeiten und
|
||||
Playwright mit Chromium, aber keine API oder Datenbank. Aus `apps/web`:
|
||||
|
||||
```bash
|
||||
@@ -34,11 +37,36 @@ go test ./internal/httpapi -run TestPronunciationBrowserSmoke -v -count=1
|
||||
Auch diese Fixture benötigt den freien Port 15175. Alle drei Browser-Smokes
|
||||
nacheinander ausführen, nicht parallel.
|
||||
|
||||
`languages.e2e.cjs` läuft vor dem Kursbank-Smoke in derselben lokalen Fixture.
|
||||
Es prüft vollständige Übersetzungsschlüssel/Platzhalter, Sprachwahl vor dem Login,
|
||||
Registrierung, Wiederanmeldung mit Kontosprache, Speicherung nach Neuladen,
|
||||
getrennte Erklärungssprache und fehlgeschlagene Speichervorgänge. Die Bedienung
|
||||
von Aussprache, Dialog, Administration und festem Altkurs wird auf Englisch
|
||||
geprüft. Eingegebene Dialogantworten und ungespeicherte Budgetfelder müssen einen
|
||||
Sprachwechsel überstehen; die Sprachwahl darf diese Felder nicht speichern.
|
||||
Lokale Statusmeldungen wechseln mit der Oberfläche ihre Sprache. Ein UI-only-PATCH
|
||||
muss die aktive Lernsprache, A2-Niveau und ein abweichendes Tagesziel erhalten.
|
||||
Die Kontoeinstellungen der Fixture werden vor dem anschließenden Bank-Smoke zurückgesetzt.
|
||||
Alle Konten und Änderungen liegen ausschließlich in dessen zufälligem Testschema.
|
||||
|
||||
`course-variants.e2e.cjs` läuft zusätzlich mit einem neuen regulären Testkonto.
|
||||
Es prüft die Erklärungssprachwahl unabhängig von der Oberfläche, alle zwölf
|
||||
Pilotvarianten, die fünf Darstellungen, angepasste Bedeutungs-/Schreibaufgaben,
|
||||
private Hörtexte und Lösungsschlüssel, unbenotete Antworten, Reload und die
|
||||
unveränderte historische Ansicht nach einem Präferenzwechsel. Fehlende englische
|
||||
Module erhalten keine deutschen Reserven; neue englische Tests werden abgelehnt,
|
||||
während ein vorhandener deutscher Test über dieselbe Request-ID fortgesetzt
|
||||
wird. Der Test löst keine Modellaufrufe aus. Der gesamte Bank-Smoke läuft danach
|
||||
weiterhin vollständig auf Deutsch und Englisch als Oberflächensprache.
|
||||
|
||||
`course-bank.e2e.cjs` prüft den Kurs mit 840 Aufgaben, sieben Modulen, allen sechs
|
||||
Lernbereichen und den fünf Darstellungsformen. Geprüft werden außerdem neue
|
||||
Aufgabenzuweisungen, Neuladen, unbewertete offene Antworten mit Selbstvergleich
|
||||
und ein vollständig abgegebener Test ohne vorzeitige Note oder Lösungsausgabe.
|
||||
Die Prüfung bestätigt, dass dabei keine Modellaufrufe erfasst werden.
|
||||
Die Prüfung läuft vollständig auf Deutsch und Englisch und bestätigt, dass dabei
|
||||
keine Modellaufrufe erfasst werden. Sichtbare Aufgaben und Auswahloptionen müssen
|
||||
den gespeicherten Originalen entsprechen; eine eingegebene Schreibantwort muss
|
||||
beim Wechsel der Oberflächensprache erhalten bleiben.
|
||||
|
||||
Aus `apps/api` mit den unten beschriebenen Voraussetzungen:
|
||||
|
||||
|
||||
@@ -19,12 +19,18 @@ const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
|
||||
import React from '/node_modules/.vite/deps/react.js';
|
||||
import ReactDOM from '/node_modules/.vite/deps/react-dom_client.js';
|
||||
import { AudioRecorder } from '/src/components/AudioRecorder.tsx';
|
||||
import { I18nProvider, useI18n } from '/src/i18n/I18n.tsx';
|
||||
import '/src/app/styles.css';
|
||||
const root = ReactDOM.createRoot(document.getElementById('root'));
|
||||
function RecorderFixture(props) {
|
||||
const { setLanguage } = useI18n();
|
||||
window.setRecorderLanguage = setLanguage;
|
||||
return React.createElement(AudioRecorder, props);
|
||||
}
|
||||
window.blobs = [];
|
||||
window.renderRecorder = (maxSeconds, enableMonitoring = false) => root.render(React.createElement(AudioRecorder, {
|
||||
window.renderRecorder = (maxSeconds, enableMonitoring = false) => root.render(React.createElement(I18nProvider, null, React.createElement(RecorderFixture, {
|
||||
key: String(maxSeconds) + enableMonitoring, maxSeconds, enableMonitoring, onRecorded: blob => window.blobs.push(blob)
|
||||
}));
|
||||
})));
|
||||
window.unmountRecorder = () => root.unmount();
|
||||
window.renderRecorder();
|
||||
</script></html>`);
|
||||
@@ -39,10 +45,18 @@ const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
|
||||
await page.addInitScript(() => {
|
||||
const RealContext = window.AudioContext;
|
||||
window.contexts = [];
|
||||
window.captures = [];
|
||||
window.monitors = [];
|
||||
window.streams = [];
|
||||
window.AudioContext = class extends RealContext {
|
||||
constructor(options) { super(options); window.contexts.push(this); }
|
||||
createScriptProcessor(...args) {
|
||||
const processor = super.createScriptProcessor(...args);
|
||||
const capture = { samples: 0, rate: this.sampleRate };
|
||||
window.captures.push(capture);
|
||||
processor.addEventListener('audioprocess', event => { capture.samples += event.inputBuffer.length; });
|
||||
return processor;
|
||||
}
|
||||
createGain() {
|
||||
const gain = super.createGain();
|
||||
const analyser = super.createAnalyser();
|
||||
@@ -95,6 +109,8 @@ const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
|
||||
await page.waitForFunction(() => window.monitorRMS() > 0.1 && window.monitorRMS() < 0.2);
|
||||
await toggle.uncheck();
|
||||
await page.waitForFunction(() => window.monitorRMS() < 0.001);
|
||||
// Collect enough real callback frames for the RMS windows checked below.
|
||||
await page.waitForFunction(() => window.captures.at(-1).samples >= window.captures.at(-1).rate * 0.6);
|
||||
await page.getByRole('button', { name: 'Stoppen' }).click();
|
||||
await page.waitForFunction(() => window.contexts.every(c => c.state === 'closed'));
|
||||
assert(await page.evaluate(() => window.streams.every(s => s.getTracks().every(t => t.readyState === 'ended'))));
|
||||
@@ -129,6 +145,21 @@ const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
|
||||
await page.evaluate(() => { window.rejectMic = false; window.renderRecorder(1); });
|
||||
await page.getByRole('button', { name: 'Aufnehmen', exact: true }).click();
|
||||
await page.waitForFunction(() => window.blobs.length === 1 && window.contexts.every(c => c.state === 'closed'));
|
||||
await page.evaluate(() => { window.renderRecorder(undefined, true); window.setRecorderLanguage('en-US'); });
|
||||
await page.getByRole('button', { name: 'Record', exact: true }).click();
|
||||
await page.getByRole('button', { name: 'Stop', exact: true }).waitFor();
|
||||
const streamsBefore = await page.evaluate(() => window.streams.length);
|
||||
const blobsBefore = await page.evaluate(() => window.blobs.length);
|
||||
await page.evaluate(() => window.setRecorderLanguage('de-DE'));
|
||||
await page.getByRole('button', { name: 'Stoppen', exact: true }).waitFor();
|
||||
assert.equal(await page.evaluate(() => window.streams.length), streamsBefore);
|
||||
assert.equal(await page.evaluate(() => window.contexts.at(-1).state), 'running');
|
||||
await page.evaluate(() => window.setRecorderLanguage('en-US'));
|
||||
await page.getByRole('switch', { name: 'Monitor your own voice' }).waitFor();
|
||||
await page.getByRole('slider', { name: 'Monitoring volume', exact: true }).waitFor();
|
||||
await page.waitForFunction(() => window.captures.at(-1).samples > 0);
|
||||
await page.getByRole('button', { name: 'Stop', exact: true }).click();
|
||||
await page.waitForFunction(count => window.blobs.length === count + 1, blobsBefore);
|
||||
assert.deepEqual(errors, []);
|
||||
await page.setViewportSize({ width: 320, height: 800 });
|
||||
assert(await page.evaluate(() => document.documentElement.scrollWidth <= innerWidth));
|
||||
|
||||
@@ -3,27 +3,32 @@ const assert=require('node:assert/strict');
|
||||
const crypto=require('node:crypto');
|
||||
(async()=>{
|
||||
const api=process.env.AI_E2E_API,token=process.env.AI_E2E_TOKEN,url=process.env.AI_E2E_URL;assert(api&&token&&url);
|
||||
const english=process.env.UI_E2E_LANGUAGE==='en-US';
|
||||
const translations={
|
||||
'A1-Kurs':'A1 course','A1-Module':'A1 modules','Lernbereich':'Learning area','Aktuelle Kursaufgabe':'Current course exercise','Nächste Aufgabe':'Next exercise','Aus geprüftem Aufgabenbestand':'From the reviewed exercise bank','Grammatik':'Grammar','Antwort prüfen':'Check answer','100 / 100 · Richtig':'100 / 100 · Correct','Wortschatz':'Vocabulary','Lesen':'Reading','Hören':'Listening','Anhören':'Listen','Sprechen':'Speaking','Bis zu 30 Sekunden.':'Up to 30 seconds.','Schreiben':'Writing','Deine Antwort':'Your answer','Antwort gespeichert – ohne verbindliche Note.':'Answer saved without a grade.','Beispiel:':'Example:','Bewertung anfordern':'Request evaluation','Neuen A1-Test starten · 12 Aufgaben':'Start a new A1 test · 12 questions','A1-Test':'A1 test','Abgegeben – Bewertung ausstehend.':'Submitted – evaluation pending.','Ausstehende Antworten bewerten':'Evaluate pending answers'
|
||||
};
|
||||
const label=value=>english?(translations[value]??value):value;
|
||||
const browser=await chromium.launch({headless:true,args:['--no-sandbox']});
|
||||
try{
|
||||
const page=await browser.newPage();page.setDefaultTimeout(15000);const errors=[];page.on('pageerror',e=>errors.push(e.message));const headers={Authorization:`Bearer ${token}`};
|
||||
const get=async path=>{const r=await page.request.get(api+path,{headers});assert.equal(r.status(),200);return r.json()};
|
||||
const post=async(path,data)=>{const r=await page.request.post(api+path,{headers,data});assert(r.status()<300,await r.text());return r.json()};
|
||||
await page.goto(url);await page.evaluate(t=>localStorage.setItem('speech_token',t),token);await page.reload();await page.getByRole('button',{name:'A1-Kurs',exact:true}).click();
|
||||
await page.goto(url);await page.evaluate(t=>localStorage.setItem('speech_token',t),token);await page.reload();if(english)await page.getByRole('combobox',{name:'Oberflächensprache'}).selectOption('en-US');await page.getByRole('button',{name:label('A1-Kurs'),exact:true}).click();
|
||||
const cat=await get('/course/catalog');assert.equal(cat.task_mode,'bank');assert.equal(cat.grading_available,false);assert.equal(cat.bank.reduce((n,b)=>n+b.total,0),840);
|
||||
const modules=page.getByRole('navigation',{name:'A1-Module'}).getByRole('button');await modules.nth(6).waitFor();assert.equal(await modules.count(),7);await modules.nth(1).click();
|
||||
const areas=page.getByRole('group',{name:'Lernbereich'}),ex=page.getByRole('region',{name:'Aktuelle Kursaufgabe'});
|
||||
async function next(area){await areas.getByRole('button',{name:area,exact:true}).click();const response=page.waitForResponse(r=>r.url().endsWith('/tasks/next')&&r.request().method()==='POST');await page.getByRole('button',{name:'Nächste Aufgabe',exact:true}).click();let j=await(await response).json();for(let n=0;n<40&&j.status!=='succeeded';n++){await page.waitForTimeout(150);j=await get('/course/jobs/'+j.id);if(j.status==='failed')throw new Error(j.error)}assert.equal(j.source,'curated');await ex.getByText('Aus geprüftem Aufgabenbestand',{exact:false}).waitFor();await page.getByRole('button',{name:'Nächste Aufgabe',exact:true}).waitFor({state:'visible'});return get('/course/tasks/'+j.task_id)}
|
||||
let d=await next('Grammatik');const first=d.task.id;assert.equal(d.task.answer_key,undefined);await ex.getByRole('radio').first().check();await ex.getByRole('button',{name:'Antwort prüfen',exact:true}).click();await ex.getByRole('status').waitFor();d=await get('/course/tasks/'+first);await ex.locator('input[value="'+d.task.answer_key.correct_option_id+'"]').check();await ex.getByRole('button',{name:'Antwort prüfen',exact:true}).click();await ex.getByText('100 / 100 · Richtig',{exact:true}).waitFor();
|
||||
await page.reload();await page.getByRole('button',{name:'A1-Kurs',exact:true}).click();await ex.getByText('100 / 100 · Richtig',{exact:true}).waitFor();d=await next('Grammatik');assert.notEqual(d.task.id,first);
|
||||
await next('Wortschatz');await next('Lesen');await ex.locator('.course-passage').waitFor();d=await next('Hören');assert.equal(d.task.audio_text,undefined);await ex.getByRole('button',{name:'Anhören',exact:true}).waitFor();
|
||||
await next('Sprechen');await ex.getByText('Bis zu 30 Sekunden.',{exact:false}).waitFor();d=await next('Schreiben');await ex.getByRole('textbox',{name:'Deine Antwort'}).fill('I have got a sister.');await ex.getByRole('button',{name:'Antwort prüfen',exact:true}).click();await ex.getByText('Antwort gespeichert – ohne verbindliche Note.',{exact:false}).waitFor();await ex.getByText('Beispiel:',{exact:false}).waitFor();
|
||||
await page.reload();await page.getByRole('button',{name:'A1-Kurs',exact:true}).click();await ex.getByText('Antwort gespeichert – ohne verbindliche Note.',{exact:false}).waitFor();assert(await ex.getByRole('button',{name:'Bewertung anfordern',exact:true}).isDisabled());
|
||||
await modules.nth(6).click();await page.getByRole('button',{name:'Neuen A1-Test starten · 12 Aufgaben',exact:true}).click();const examPanel=page.getByRole('region',{name:'A1-Test'});await examPanel.getByRole('button').nth(11).waitFor();let catalog=await get('/course/catalog'),exam=await get('/course/exams/'+catalog.exams[0].id);assert.equal(exam.tasks.length,12);
|
||||
const modules=page.getByRole('navigation',{name:label('A1-Module')}).getByRole('button');await modules.nth(6).waitFor();assert.equal(await modules.count(),7);await modules.nth(1).click();
|
||||
const areas=page.getByRole('group',{name:label('Lernbereich')}),ex=page.getByRole('region',{name:label('Aktuelle Kursaufgabe')});
|
||||
async function next(area){await areas.getByRole('button',{name:label(area),exact:true}).click();const response=page.waitForResponse(r=>r.url().endsWith('/tasks/next')&&r.request().method()==='POST');await page.getByRole('button',{name:label('Nächste Aufgabe'),exact:true}).click();let j=await(await response).json();for(let n=0;n<40&&j.status!=='succeeded';n++){await page.waitForTimeout(150);j=await get('/course/jobs/'+j.id);if(j.status==='failed')throw new Error(j.error)}assert.equal(j.source,'curated');await ex.getByText(label('Aus geprüftem Aufgabenbestand'),{exact:false}).waitFor();await page.getByRole('button',{name:label('Nächste Aufgabe'),exact:true}).waitFor({state:'visible'});return get('/course/tasks/'+j.task_id)}
|
||||
let d=await next('Grammatik');const first=d.task.id;assert.equal(d.task.answer_key,undefined);assert.equal(await ex.getByRole('heading',{level:2}).innerText(),d.task.prompt);assert.deepEqual(await ex.locator('.course-option').allTextContents(),d.task.options.map(o=>o.label));await ex.getByRole('radio').first().check();await ex.getByRole('button',{name:label('Antwort prüfen'),exact:true}).click();await ex.getByRole('status').waitFor();d=await get('/course/tasks/'+first);await ex.locator('input[value="'+d.task.answer_key.correct_option_id+'"]').check();await ex.getByRole('button',{name:label('Antwort prüfen'),exact:true}).click();await ex.getByText(label('100 / 100 · Richtig'),{exact:true}).waitFor();
|
||||
await page.reload();await page.getByRole('button',{name:label('A1-Kurs'),exact:true}).click();await ex.getByText(label('100 / 100 · Richtig'),{exact:true}).waitFor();d=await next('Grammatik');assert.notEqual(d.task.id,first);
|
||||
await next('Wortschatz');await next('Lesen');await ex.locator('.course-passage').waitFor();d=await next('Hören');assert.equal(d.task.audio_text,undefined);await ex.getByRole('button',{name:label('Anhören'),exact:true}).waitFor();
|
||||
await next('Sprechen');await ex.getByText(label('Bis zu 30 Sekunden.'),{exact:false}).waitFor();d=await next('Schreiben');await ex.getByRole('textbox',{name:label('Deine Antwort')}).fill('I have got a sister.');if(english){await page.getByRole('combobox',{name:'Interface language'}).selectOption('de-DE');const germanExercise=page.getByRole('region',{name:'Aktuelle Kursaufgabe'});await germanExercise.getByRole('textbox',{name:'Deine Antwort'}).waitFor();assert.equal(await germanExercise.getByRole('textbox',{name:'Deine Antwort'}).inputValue(),'I have got a sister.');assert.equal(await germanExercise.getByRole('heading',{level:2}).innerText(),d.task.prompt);await page.getByRole('combobox',{name:'Oberflächensprache'}).selectOption('en-US');}await ex.getByRole('button',{name:label('Antwort prüfen'),exact:true}).click();await ex.getByText(label('Antwort gespeichert – ohne verbindliche Note.'),{exact:false}).waitFor();await ex.getByText(label('Beispiel:'),{exact:false}).waitFor();
|
||||
await page.reload();await page.getByRole('button',{name:label('A1-Kurs'),exact:true}).click();await ex.getByText(label('Antwort gespeichert – ohne verbindliche Note.'),{exact:false}).waitFor();assert(await ex.getByRole('button',{name:label('Bewertung anfordern'),exact:true}).isDisabled());
|
||||
await modules.nth(6).click();await page.getByRole('button',{name:label('Neuen A1-Test starten · 12 Aufgaben'),exact:true}).click();const examPanel=page.getByRole('region',{name:label('A1-Test')});await examPanel.getByRole('button').nth(11).waitFor();let catalog=await get('/course/catalog'),exam=await get('/course/exams/'+catalog.exams[0].id);assert.equal(exam.tasks.length,12);
|
||||
const wav=Buffer.alloc(44+8000);wav.write('RIFF');wav.writeUInt32LE(wav.length-8,4);wav.write('WAVE',8);wav.write('fmt ',12);wav.writeUInt32LE(16,16);wav.writeUInt16LE(1,20);wav.writeUInt16LE(1,22);wav.writeUInt32LE(16000,24);wav.writeUInt32LE(32000,28);wav.writeUInt16LE(2,32);wav.writeUInt16LE(16,34);wav.write('data',36);wav.writeUInt32LE(8000,40);
|
||||
for(const t of exam.tasks){assert.equal(t.answer_key,undefined);assert.equal(t.audio_text,undefined);const request_id=crypto.randomUUID().replaceAll('-','');if(['repeat_sentence','free_speech'].includes(t.kind)){const r=await page.request.post(api+'/course/tasks/'+t.id+'/audio-attempts',{headers,multipart:{request_id,audio:{name:'fixture.wav',mimeType:'audio/wav',buffer:wav}}});assert.equal(r.status(),202,await r.text())}else await post('/course/tasks/'+t.id+'/attempts',{request_id,answer:t.kind==='choice'?t.options[0].id:'I have got a sister.'})}
|
||||
exam=await get('/course/exams/'+exam.id);assert.equal(exam.status,'submitted');assert.equal(exam.score,undefined);for(const t of exam.tasks){assert.equal(t.answer_key,undefined);assert.equal(t.audio_text,undefined);const detail=await get('/course/tasks/'+t.id);assert.equal(detail.task.answer_key,undefined)}for(const a of exam.attempts)assert.equal(a.evaluation,undefined);
|
||||
await page.reload();await page.getByRole('button',{name:'A1-Kurs',exact:true}).click();await examPanel.getByText('Abgegeben – Bewertung ausstehend.',{exact:false}).waitFor();assert(await examPanel.getByRole('button',{name:'Ausstehende Antworten bewerten',exact:true}).isDisabled());
|
||||
await page.reload();await page.getByRole('button',{name:label('A1-Kurs'),exact:true}).click();await examPanel.getByText(label('Abgegeben – Bewertung ausstehend.'),{exact:false}).waitFor();assert(await examPanel.getByRole('button',{name:label('Ausstehende Antworten bewerten'),exact:true}).isDisabled());
|
||||
const usage=await get('/admin/ai/usage');assert.equal(usage.total,0);assert.deepEqual(errors,[]);
|
||||
console.log('PASS: 840 bank tasks; six renderers; source/privacy; answer/reload; ungraded open answer; submitted frozen exam; no model calls or browser errors. Audio uses an explicit local fixture.');
|
||||
console.log((english?'English: ':'German: ')+'PASS: 840 bank tasks; six renderers; source/privacy; answer/reload; ungraded open answer; submitted frozen exam; no model calls or browser errors. Audio uses an explicit local fixture.');
|
||||
}finally{await browser.close()}
|
||||
})().catch(e=>{console.error(e);process.exitCode=1});
|
||||
|
||||
@@ -0,0 +1,118 @@
|
||||
// Local API/PostgreSQL fixture only. No paid provider calls or real microphone.
|
||||
const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
|
||||
const assert = require('node:assert/strict');
|
||||
const crypto = require('node:crypto');
|
||||
|
||||
(async () => {
|
||||
const api = process.env.AI_E2E_API, url = process.env.AI_E2E_URL, adminToken = process.env.AI_E2E_TOKEN;
|
||||
assert(api && url && adminToken);
|
||||
const browser = await chromium.launch({ headless: true, args: ['--no-sandbox'] });
|
||||
try {
|
||||
const page = await browser.newPage(); page.setDefaultTimeout(15000);
|
||||
const errors = []; page.on('pageerror', error => errors.push(error.message));
|
||||
const registration = await page.request.post(api + '/auth/register', { data: { email: `variants-${Date.now()}@example.test`, password: 'local-variant-test-password', ui_language: 'en-US', target_language: 'en-US' } });
|
||||
assert.equal(registration.status(), 201);
|
||||
const account = await registration.json(), headers = { Authorization: `Bearer ${account.token}` };
|
||||
const id = () => crypto.randomUUID().replaceAll('-', '');
|
||||
const get = async path => { const response = await page.request.get(api + path, { headers }); assert.equal(response.status(), 200, await response.text()); return response.json(); };
|
||||
const explanation = () => page.getByRole('combobox', { name: 'Exercise explanation language' });
|
||||
const exercise = page.getByRole('region', { name: 'Current course exercise' });
|
||||
async function waitJob(job) {
|
||||
for (let count = 0; count < 80 && ['queued', 'running'].includes(job.status); count++) {
|
||||
await page.waitForTimeout(100); job = await get('/course/jobs/' + job.id);
|
||||
}
|
||||
return job;
|
||||
}
|
||||
async function next(skill) {
|
||||
await page.getByRole('group', { name: 'Learning area' }).getByRole('button', { name: skill, exact: true }).click();
|
||||
const response = page.waitForResponse(r => r.url().endsWith('/tasks/next') && r.request().method() === 'POST');
|
||||
await page.getByRole('button', { name: 'Next exercise', exact: true }).click();
|
||||
const job = await waitJob(await (await response).json()); assert.equal(job.status, 'succeeded', job.error);
|
||||
const detail = await get('/course/tasks/' + job.task_id);
|
||||
await exercise.getByRole('heading', { level: 2, name: detail.task.instruction, exact: true }).waitFor();
|
||||
await page.getByRole('button', { name: 'Next exercise', exact: true }).waitFor();
|
||||
assert.equal(detail.task.instruction_language, 'en-US'); assert(detail.task.content_revision); assert(detail.task.variant_id);
|
||||
assert.equal(detail.task.answer_key, undefined); assert.equal(detail.task.audio_text, undefined); assert.equal(detail.task.evidence_task_id, undefined);
|
||||
return detail.task;
|
||||
}
|
||||
await page.goto(url); await page.evaluate(token => localStorage.setItem('speech_token', token), account.token); await page.reload();
|
||||
await page.getByRole('button', { name: 'A1 course', exact: true }).click();
|
||||
await explanation().selectOption('en-US');
|
||||
await page.getByText('Preferred explanation language: English.', { exact: true }).waitFor();
|
||||
let catalog = await get('/course/catalog');
|
||||
assert.equal(catalog.modules[0].title, 'Greetings & introductions');
|
||||
assert.equal(catalog.instruction_language, 'en-US'); assert.equal(catalog.exam_available, false);
|
||||
assert.equal(catalog.bank.reduce((sum, item) => sum + item.total, 0), 12);
|
||||
assert(catalog.bank.every(item => item.module_id === 'a1_introductions_v1' && item.total === 2));
|
||||
const grammar = await next('Grammar');
|
||||
await exercise.locator('.course-passage').getByText(grammar.stimulus.text, { exact: true }).waitFor();
|
||||
assert.equal(grammar.stimulus.role, 'target'); assert.equal(grammar.stimulus.language, 'en-US');
|
||||
for (let n = 0; n < 2; n++) {
|
||||
const task = await next('Vocabulary');
|
||||
assert.equal(task.canonical_task_id, task.variant_id, 'Adapted meanings require a separate canonical identity');
|
||||
assert(task.options.every(option => option.language === 'en-US' && !['hello', 'name'].includes(option.label.toLowerCase())));
|
||||
assert(!task.options.some(option => ['hallo', 'tschüss', 'Name', 'Alter', 'Wohnort'].includes(option.label)));
|
||||
}
|
||||
await next('Reading'); await exercise.locator('.course-passage').waitFor();
|
||||
const listening = await next('Listening'); assert.equal(listening.stimulus, undefined);
|
||||
await exercise.getByRole('button', { name: 'Listen', exact: true }).waitFor();
|
||||
assert.equal(await exercise.getByText('Listening transcript:', { exact: false }).count(), 0);
|
||||
for (let n = 0; n < 2; n++) {
|
||||
const task = await next('Speaking');
|
||||
assert(['repeat_sentence', 'free_speech'].includes(task.kind));
|
||||
await exercise.getByRole('button', { name: 'Record', exact: true }).waitFor();
|
||||
assert.equal(Boolean(task.reference_text), task.kind === 'repeat_sentence');
|
||||
}
|
||||
const writing = await next('Writing');
|
||||
assert.equal(writing.kind, 'short_text'); assert.equal(writing.canonical_task_id, writing.variant_id);
|
||||
assert(!writing.instruction.toLowerCase().includes('translate')); assert.equal(writing.stimulus.role, 'context');
|
||||
await exercise.getByRole('textbox', { name: 'Your answer' }).fill('I am Anna.');
|
||||
await exercise.getByRole('button', { name: 'Check answer', exact: true }).click();
|
||||
await exercise.getByText('Answer saved without a grade.', { exact: false }).waitFor();
|
||||
let saved = await get('/course/tasks/' + writing.id);
|
||||
assert.equal(saved.attempt.status, 'ungraded'); assert.equal(saved.attempt.answer, 'I am Anna.'); assert.equal(saved.attempt.evaluation, undefined);
|
||||
assert.equal(saved.task.answer_key.reference_answer_language, 'en-US');
|
||||
const frozen = saved.task;
|
||||
await explanation().selectOption('de-DE');
|
||||
await page.getByText('Preferred explanation language: German.', { exact: true }).waitFor();
|
||||
await exercise.getByText('This exercise uses: English', { exact: true }).waitFor();
|
||||
saved = await get('/course/tasks/' + writing.id); assert.deepEqual(saved.task, frozen);
|
||||
await page.reload(); await page.getByRole('button', { name: 'A1 course', exact: true }).click();
|
||||
await exercise.getByRole('heading', { name: writing.instruction, exact: true }).waitFor();
|
||||
saved = await get('/course/tasks/' + writing.id); assert.equal(saved.attempt.answer, 'I am Anna.'); assert.deepEqual(saved.task, frozen);
|
||||
const currentUser = await get('/me'); assert.equal(currentUser.user.ui_language, 'en-US'); assert.deepEqual(currentUser.profile, account.profile);
|
||||
await explanation().selectOption('en-US');
|
||||
await page.getByText('Preferred explanation language: English.', { exact: true }).waitFor();
|
||||
const freeWriting = await next('Writing'); assert.equal(freeWriting.kind, 'free_text');
|
||||
const modules = page.getByRole('navigation', { name: 'A1 modules' }).getByRole('button');
|
||||
await modules.nth(1).click();
|
||||
await page.getByText('This area has no reviewed exercises', { exact: false }).waitFor();
|
||||
assert(await page.getByRole('button', { name: 'Next exercise', exact: true }).isDisabled());
|
||||
const missing = await page.request.post(api + '/course/modules/a1_family_v1/tasks/next', { headers, data: { request_id: id(), skill: 'grammar' } });
|
||||
assert.equal(missing.status(), 202); const failed = await waitJob(await missing.json()); assert.equal(failed.status, 'failed'); assert.equal(failed.task_id, undefined);
|
||||
assert.equal((await get('/course/modules/a1_family_v1/tasks')).tasks.length, 0);
|
||||
await modules.nth(6).click();
|
||||
assert(await page.getByRole('button', { name: 'Start a new A1 test · 12 questions', exact: true }).isDisabled());
|
||||
const unsupportedExam = await page.request.post(api + '/course/exams', { headers, data: { request_id: id() } });
|
||||
assert.equal(unsupportedExam.status(), 409); assert.equal((await unsupportedExam.json()).code, 'course_variant_unavailable');
|
||||
catalog = await get('/course/catalog'); assert.equal(catalog.exams.length, 0);
|
||||
// Reusing an existing German test request must keep that frozen session.
|
||||
await page.request.put(api + '/course/instruction-language', { headers, data: { instruction_language: 'de-DE' } });
|
||||
const examRequest = id();
|
||||
const germanExamResponse = await page.request.post(api + '/course/exams', { headers, data: { request_id: examRequest } });
|
||||
assert.equal(germanExamResponse.status(), 202);
|
||||
const germanExam = await germanExamResponse.json();
|
||||
assert.equal((await waitJob(germanExam.job)).status, 'succeeded');
|
||||
await page.request.put(api + '/course/instruction-language', { headers, data: { instruction_language: 'en-US' } });
|
||||
const replayResponse = await page.request.post(api + '/course/exams', { headers, data: { request_id: examRequest } });
|
||||
assert.equal(replayResponse.status(), 202);
|
||||
const replay = await replayResponse.json(); assert.equal(replay.exam.id, germanExam.exam.id); assert.equal(replay.job.id, germanExam.job.id); assert.equal(replay.job.instruction_language, 'de-DE');
|
||||
const unsupported = await page.request.put(api + '/course/instruction-language', { headers, data: { instruction_language: 'fr-FR' } });
|
||||
assert.equal(unsupported.status(), 409); assert.equal((await unsupported.json()).code, 'course_variant_unavailable');
|
||||
assert.equal((await get('/me')).user.instruction_language, 'en-US');
|
||||
const anonymous = await page.request.put(api + '/course/instruction-language', { data: { instruction_language: 'de-DE' } }); assert.equal(anonymous.status(), 401);
|
||||
const usage = await page.request.get(api + '/admin/ai/usage', { headers: { Authorization: `Bearer ${adminToken}` } }); assert.equal((await usage.json()).total, 0);
|
||||
assert.deepEqual(errors, []);
|
||||
console.log('PASS: explanation choice; 12 structured pilot variants; five renderers/six skills; independent UI language; adapted vocabulary/writing; frozen answers/reload; no German fallback; unavailable English exam; auth; no model calls.');
|
||||
} finally { await browser.close(); }
|
||||
})().catch(error => { console.error(error); process.exitCode = 1; });
|
||||
@@ -0,0 +1,141 @@
|
||||
const { chromium } = require(process.env.PLAYWRIGHT_MODULE || 'playwright');
|
||||
const assert = require('node:assert/strict');
|
||||
const fs = require('node:fs');
|
||||
|
||||
(async () => {
|
||||
const api = process.env.AI_E2E_API, token = process.env.AI_E2E_TOKEN, url = process.env.AI_E2E_URL;
|
||||
assert(api && token && url);
|
||||
const german = JSON.parse(fs.readFileSync('src/i18n/de-DE.json', 'utf8'));
|
||||
const english = JSON.parse(fs.readFileSync('src/i18n/en-US.json', 'utf8'));
|
||||
assert.deepEqual(Object.keys(german).sort(), Object.keys(english).sort());
|
||||
for (const key of Object.keys(german)) {
|
||||
assert(german[key] && english[key], `Empty translation: ${key}`);
|
||||
assert.deepEqual(german[key].match(/\{\w+\}/g)?.sort() ?? [], english[key].match(/\{\w+\}/g)?.sort() ?? [], key);
|
||||
}
|
||||
const browser = await chromium.launch({ headless: true, args: ['--no-sandbox'] });
|
||||
try {
|
||||
const page = await browser.newPage();
|
||||
page.setDefaultTimeout(15000);
|
||||
const errors = [];
|
||||
page.on('pageerror', (error) => errors.push(error.message));
|
||||
const headers = { Authorization: `Bearer ${token}` };
|
||||
const me = async () => {
|
||||
const response = await page.request.get(api + '/me', { headers });
|
||||
assert.equal(response.status(), 200);
|
||||
return response.json();
|
||||
};
|
||||
const patch = async (data) => {
|
||||
const response = await page.request.patch(api + '/me/preferences', { headers, data });
|
||||
assert.equal(response.status(), 200, await response.text());
|
||||
return response.json();
|
||||
};
|
||||
await page.goto(url);
|
||||
await page.getByRole('heading', { name: 'Einloggen', exact: true }).waitFor();
|
||||
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
|
||||
await page.getByRole('heading', { name: 'Log in', exact: true }).waitFor();
|
||||
assert.equal(await page.locator('html').getAttribute('lang'), 'en-US');
|
||||
await page.reload();
|
||||
await page.getByRole('heading', { name: 'Log in', exact: true }).waitFor();
|
||||
await page.getByRole('button', { name: 'Create account', exact: true }).click();
|
||||
await page.getByText('The English course currently uses German task instructions and explanations.').waitFor();
|
||||
await page.setViewportSize({ width: 360, height: 780 });
|
||||
assert(await page.evaluate(() => document.documentElement.scrollWidth <= window.innerWidth), 'Registration overflows on a narrow screen');
|
||||
await page.setViewportSize({ width: 1280, height: 800 });
|
||||
const email = `languages-${Date.now()}@example.test`, password = 'local-language-test-password';
|
||||
await page.getByRole('textbox', { name: 'Email', exact: true }).fill(email);
|
||||
await page.getByLabel('Password', { exact: true }).fill(password);
|
||||
const registration = page.waitForResponse((r) => r.url().endsWith('/auth/register') && r.request().method() === 'POST');
|
||||
await page.getByRole('button', { name: 'Register', exact: true }).click();
|
||||
const registered = await (await registration).json();
|
||||
assert.equal(registered.user.ui_language, 'en-US');
|
||||
assert.equal(registered.user.instruction_language, 'de-DE');
|
||||
await page.getByRole('button', { name: 'Today', exact: true }).waitFor();
|
||||
await page.getByText('Preferred explanation language: German.', { exact: true }).waitFor();
|
||||
await page.getByRole('heading', { name: 'A1 pronunciation practice', exact: true }).waitFor();
|
||||
await page.getByRole('button', { name: 'Log out', exact: true }).click();
|
||||
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
|
||||
await page.getByRole('textbox', { name: 'E-Mail', exact: true }).fill(email);
|
||||
await page.getByLabel('Passwort', { exact: true }).fill(password);
|
||||
await page.getByRole('button', { name: 'Einloggen', exact: true }).click();
|
||||
await page.getByRole('button', { name: 'Today', exact: true }).waitFor();
|
||||
await page.getByRole('button', { name: 'Progress', exact: true }).click();
|
||||
await page.getByRole('heading', { name: 'Progress', exact: true }).waitFor();
|
||||
await page.getByRole('heading', { name: 'Your pronunciation profile · en-US', exact: true }).waitFor();
|
||||
await page.getByText('Your new pronunciation profile needs confirmed measurements.', { exact: false }).waitFor();
|
||||
await page.getByRole('button', { name: 'Log out', exact: true }).click();
|
||||
|
||||
const original = await me();
|
||||
await page.evaluate((value) => localStorage.setItem('speech_token', value), token);
|
||||
await page.reload();
|
||||
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
|
||||
await page.getByRole('button', { name: 'Pronunciation', exact: true }).click();
|
||||
await page.getByRole('button', { name: 'Record', exact: true }).waitFor();
|
||||
const sentence = await page.locator('.target-text').innerText();
|
||||
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
|
||||
await page.getByRole('button', { name: 'Aufnehmen', exact: true }).waitFor();
|
||||
assert.equal(await page.locator('.target-text').innerText(), sentence);
|
||||
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
|
||||
await page.getByRole('button', { name: 'Conversation', exact: true }).click();
|
||||
await page.getByRole('button', { name: 'Start', exact: true }).click();
|
||||
const reply = page.getByRole('textbox', { name: 'Your conversation reply', exact: true });
|
||||
await reply.fill('My name is Mira.');
|
||||
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
|
||||
assert.equal(await page.getByRole('textbox', { name: 'Deine Dialogantwort', exact: true }).inputValue(), 'My name is Mira.');
|
||||
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
|
||||
const turnResponse = page.waitForResponse(r => /\/conversation\/[^/]+\/turn$/.test(r.url()));
|
||||
await page.getByRole('button', { name: 'Send', exact: true }).click();
|
||||
assert.equal((await turnResponse).request().postDataJSON().text, 'My name is Mira.');
|
||||
await page.locator('.bubble.learner').getByText('My name is Mira.', { exact: true }).waitFor();
|
||||
await page.getByRole('button', { name: 'Administration', exact: true }).click();
|
||||
await page.getByRole('heading', { name: 'AI settings and usage', exact: true }).waitFor();
|
||||
const action = page.getByLabel('Action').first();
|
||||
await action.selectOption('next_exercise');
|
||||
await page.getByRole('option', { name: 'Pronunciation generation', exact: true }).first().waitFor({ state: 'attached' });
|
||||
await page.getByLabel('Monthly limit in USD', { exact: true }).fill('0.12');
|
||||
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
|
||||
assert.equal(await page.getByLabel('Monatslimit in USD', { exact: true }).inputValue(), '0.12');
|
||||
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
|
||||
assert.equal(await page.getByLabel('Monthly limit in USD', { exact: true }).inputValue(), '0.12');
|
||||
const settings = await (await page.request.get(api + '/admin/ai/settings', { headers })).json();
|
||||
assert.equal(settings.budget.monthly_limit_microusd, 0, 'Changing UI language must not save budget edits');
|
||||
await page.getByLabel('Monthly limit in USD', { exact: true }).fill('0');
|
||||
await page.getByRole('button', { name: 'Save budget', exact: true }).click();
|
||||
await page.getByRole('status').filter({ hasText: 'Budget saved.' }).waitFor();
|
||||
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
|
||||
await page.getByRole('status').filter({ hasText: 'Budget gespeichert.' }).waitFor();
|
||||
await page.getByRole('combobox', { name: 'Oberflächensprache' }).selectOption('en-US');
|
||||
await page.getByRole('status').filter({ hasText: 'Budget saved.' }).waitFor();
|
||||
await page.getByRole('button', { name: 'A1 course', exact: true }).click();
|
||||
await page.getByRole('button', { name: 'Open the original fixed course', exact: true }).click();
|
||||
await page.getByText('Guided A1 course', { exact: true }).waitFor();
|
||||
await page.getByRole('region', { name: 'Module progress', exact: true }).waitFor();
|
||||
await patch({ ui_language: original.user.ui_language });
|
||||
const learningProfile = await patch({ target_language: 'es-ES', cefr_level: 'A2', daily_goal_minutes: 23 });
|
||||
await page.evaluate((value) => localStorage.setItem('speech_token', value), token);
|
||||
await page.reload();
|
||||
const picker = page.getByRole('combobox', { name: 'Oberflächensprache' });
|
||||
await picker.waitFor();
|
||||
await picker.selectOption('en-US');
|
||||
await page.getByRole('button', { name: 'Today', exact: true }).waitFor();
|
||||
let account = await me();
|
||||
assert.equal(account.user.ui_language, 'en-US');
|
||||
assert.equal(account.user.instruction_language, original.user.instruction_language);
|
||||
assert.deepEqual(account.profile, learningProfile);
|
||||
await page.reload();
|
||||
await page.getByRole('combobox', { name: 'Interface language' }).waitFor();
|
||||
assert.equal(await page.locator('html').getAttribute('lang'), 'en-US');
|
||||
await page.route('**/me/preferences', (route) => route.fulfill({ status: 503, contentType: 'application/json', body: '{"error":"fixture unavailable"}' }));
|
||||
await page.getByRole('combobox', { name: 'Interface language' }).selectOption('de-DE');
|
||||
await page.getByRole('alert').filter({ hasText: 'Unable to save the language.' }).waitFor();
|
||||
assert.equal(await page.getByRole('combobox', { name: 'Interface language' }).inputValue(), 'en-US');
|
||||
account = await me();
|
||||
assert.equal(account.user.ui_language, 'en-US');
|
||||
assert.deepEqual(account.profile, learningProfile);
|
||||
await page.unroute('**/me/preferences');
|
||||
const rejected = await page.request.patch(api + '/me/preferences', { headers, data: { ui_language: 'xx-XX' } });
|
||||
assert.equal(rejected.status(), 400);
|
||||
await patch({ ui_language: original.user.ui_language, target_language: original.profile.target_language, cefr_level: original.profile.cefr_level, daily_goal_minutes: original.profile.daily_goal_minutes });
|
||||
assert.deepEqual(errors, []);
|
||||
console.log('PASS: catalog parity; language before login; registration/login; account persistence; independent instructions; pronunciation, conversation, admin and legacy controls; unsaved input survives language switches; partial PATCH preserves course/level/goal; rejected saves; no browser errors.');
|
||||
} finally { await browser.close(); }
|
||||
})().catch((error) => { console.error(error); process.exitCode = 1; });
|
||||
Reference in New Issue
Block a user